Jun 26 02:37:49.053817 np0000003683 systemd[1]: Started devstack@c-bak.service - Devstack devstack@c-bak.service. Jun 26 02:37:49.181373 np0000003683 cinder-backup[101221]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 26 02:37:49.181373 np0000003683 cinder-backup[101221]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 26 02:37:49.181373 np0000003683 cinder-backup[101221]: we strongly recommend against using it for new projects. Jun 26 02:37:49.181373 np0000003683 cinder-backup[101221]: If you are already using Eventlet, we recommend migrating to a different Jun 26 02:37:49.181373 np0000003683 cinder-backup[101221]: framework. For more detail see Jun 26 02:37:49.181373 np0000003683 cinder-backup[101221]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 26 02:37:49.181373 np0000003683 cinder-backup[101221]: import eventlet # noqa Jun 26 02:37:50.181024 np0000003683 cinder-backup[101221]: INFO cinder.cmd.backup [-] Backup running in single process mode. Jun 26 02:37:50.273078 np0000003683 cinder-backup[101221]: INFO dbcounter [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] Registered counter for database cinder Jun 26 02:37:50.311642 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:37:50.401135 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writer thread running {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 26 02:37:50.404777 np0000003683 cinder-backup[101221]: INFO cinder.rpc [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Jun 26 02:37:50.406876 np0000003683 cinder-backup[101221]: INFO cinder.rpc [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] Automatically selected cinder-backup RPC version 2.4 as minimum service version. Jun 26 02:37:50.408689 np0000003683 cinder-backup[101221]: INFO cinder.rpc [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 26 02:37:50.410273 np0000003683 cinder-backup[101221]: INFO cinder.rpc [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] Automatically selected cinder-volume RPC version 3.21 as minimum service version. Jun 26 02:37:50.412806 np0000003683 cinder-backup[101221]: INFO cinder.rpc [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 26 02:37:50.414569 np0000003683 cinder-backup[101221]: INFO cinder.rpc [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 26 02:37:50.462027 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:37:50.473349 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.lockutils [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] Acquiring lock "singleton_lock" {{(pid=101221) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 02:37:50.473463 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.lockutils [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] Acquired lock "singleton_lock" {{(pid=101221) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 02:37:50.473699 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.lockutils [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] Releasing lock "singleton_lock" {{(pid=101221) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 02:37:50.473947 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] ******************************************************************************** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 26 02:37:50.474056 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] Configuration options gathered from: {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 26 02:37:50.474156 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 26 02:37:50.474284 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 26 02:37:50.474371 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] ================================================================================ {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 26 02:37:50.474562 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] allow_availability_zone_fallback = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.474677 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] allow_compression_on_image_upload = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.474794 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] allowed_direct_url_schemes = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.474901 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] api_rate_limit = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.475014 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] auth_strategy = keystone {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.475101 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backdoor_port = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.475183 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backdoor_socket = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.475289 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_availability_zone = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.475397 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_api_class = cinder.backup.api.API {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.475531 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_compression_algorithm = zlib {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.475639 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_create_containers = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.475752 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_driver = cinder.backup.drivers.swift.SwiftBackupDriver {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.475857 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_driver_init_check_interval = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.475962 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_driver_stats_polling_interval = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.476066 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.476173 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_max_operations = 15 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.476270 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_metadata_version = 2 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.476376 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_name_template = backup-%s {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.476483 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_native_threads_pool_size = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.476607 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_object_number_per_notification = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.476737 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_service_inithost_offload = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.476847 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_auth = per_user {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.476949 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_auth_insecure = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.477052 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_auth_url = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.477156 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_auth_version = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.477256 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_block_size = 32768 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.477361 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_ca_cert_file = /opt/stack/data/ca-bundle.pem {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.477466 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_container = volumebackups {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.477591 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_create_storage_policy = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.477722 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_enable_progress_timer = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.477889 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_key = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.477976 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_object_size = 52428800 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.478076 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_project = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.478201 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_project_domain = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.478304 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_region_name = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.478404 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_retry_attempts = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.478542 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_retry_backoff = 2 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.478670 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_service_auth = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.478778 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_tenant = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.478991 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_url = https://10.4.3.9:8080/v1/AUTH_ {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.479095 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_user = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.479192 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_user_domain = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.479296 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_timer_interval = 120 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.479415 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_use_same_host = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.479554 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_use_temp_snapshot = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.479664 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_workers = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.479790 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] chap_password = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.479948 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] chap_username = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.480065 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.480176 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_internal_tenant_project_id = 1cd7b85680e34994885a309cbd63188e {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.480280 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_internal_tenant_user_id = b8f878f898b6405e8bb910ecab07a665 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.480390 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] compression_format = gzip {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.480525 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] config_dir = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.480637 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.480757 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] config_source = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.480869 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.481018 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] control_exchange = openstack {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.481091 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] debug = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.481189 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] default_availability_zone = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.481288 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] default_group_type = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.481436 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'swiftclient=WARN', 'botocore=WARN'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.481575 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] default_volume_type = storpool {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.481683 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] disk_geometry = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.481809 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] driver_client_cert = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.481912 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] driver_client_cert_key = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.482010 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] driver_data_namespace = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.482119 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] driver_ssl_cert_path = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.482262 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] driver_ssl_cert_verify = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.482395 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] driver_use_ssl = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.482533 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] enable_new_services = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.482660 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] enable_unsupported_driver = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.482780 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] enabled_backends = ['storpool'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.482882 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] enforce_multipath_for_image_xfer = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.483002 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] filter_function = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.483124 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_api_insecure = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.483235 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_api_servers = ['https://10.4.3.9/image'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.483337 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_api_ssl_compression = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.483469 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_ca_certificates_file = /opt/stack/data/ca-bundle.pem {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.483609 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_catalog_info = image:glance:publicURL {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.483707 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_certfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.483834 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.483942 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_keyfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.484068 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_num_retries = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.484181 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_request_timeout = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.484302 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] goodness_function = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.484437 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] graceful_shutdown_timeout = 5 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.484600 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] group_api_class = cinder.group.api.API {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.484737 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] host = np0000003683 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.484840 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_compress_on_upload = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.484942 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_conversion_address_space_limit = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.485041 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_conversion_cpu_limit = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.485192 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.485281 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_conversion_disable = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.485383 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_upload_use_cinder_backend = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.485533 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_upload_use_internal_tenant = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.485648 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_volume_cache_enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.485752 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_volume_cache_max_count = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.485853 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_volume_cache_max_size_gb = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.485960 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] instance_format = [instance: %(uuid)s] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.486063 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.486213 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] iscsi_target_flags = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.486338 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] iscsi_write_cache = on {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.486447 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] iser_helper = tgtadm {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.486672 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] iser_ip_address = 10.4.3.9 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.486789 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] iser_port = 3260 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.486926 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.487038 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_catalog_info = identity:Identity Service:publicURL {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.487145 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_color = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.487277 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_config_append = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.487385 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.487513 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_dir = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.487645 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_file = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.487753 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_options = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.487878 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_rotate_interval = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.488000 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_rotate_interval_type = days {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.488155 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_rotation_type = none {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.488278 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.488411 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.488617 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.488796 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.488938 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.489079 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] max_age = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.489184 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] max_logfile_count = 30 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.489282 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] max_logfile_size_mb = 200 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.489394 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] max_over_subscription_ratio = 20.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.489552 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] message_reap_interval = 86400 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.489724 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] message_ttl = 2592000 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.489855 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] monkey_patch = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.490002 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] monkey_patch_modules = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.490069 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] my_ip = 10.4.3.9 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.490143 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] no_snapshot_gb_quota = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.490244 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] num_iser_scan_tries = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.490344 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] num_shell_tries = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.490443 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] num_volume_device_scan_tries = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.490581 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] nvmeof_conn_info_version = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.490721 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] nvmet_ns_id = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.490827 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] nvmet_port_id = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.490934 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] osapi_max_limit = 1000 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.491035 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] osapi_volume_ext_list = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.491151 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.491258 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.491359 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] osapi_volume_listen_port = 8776 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.491458 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] osapi_volume_use_ssl = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.491595 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] osapi_volume_workers = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.491728 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] per_volume_size_limit = -1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.491860 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] periodic_fuzzy_delay = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.491966 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] periodic_interval = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.492073 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.492172 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] public_endpoint = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.492271 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] publish_errors = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.492371 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] quota_backup_gigabytes = 1000 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.492556 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] quota_backups = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.492738 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.492855 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] quota_gigabytes = 1000 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.492962 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] quota_groups = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.493079 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] quota_snapshots = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.493182 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] quota_volumes = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.493291 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] rate_limit_burst = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.493402 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] rate_limit_except_level = CRITICAL {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.493531 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] rate_limit_interval = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.493683 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] replication_device = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.493786 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] report_discard_supported = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.493896 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] report_interval = 120 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.494037 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] reservation_clean_interval = 86400 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.494145 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] reservation_expire = 86400 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.494298 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] reserved_image_namespaces = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.494426 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] reserved_percentage = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.494587 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.494744 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.494865 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] rpc_response_timeout = 120 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.494965 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] run_external_periodic_tasks = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.495077 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.495177 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] scst_target_driver = iscsi {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.495272 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] scst_target_iqn_name = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.495376 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_down_time = 720 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.495504 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] shell_completion = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.495607 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] snapshot_name_template = snapshot-%s {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.495731 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] split_loggers = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.495815 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] state_path = /opt/stack/data/cinder {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.495924 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] storage_availability_zone = nova {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.496046 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] storage_protocol = iSCSI {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.496185 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] swift_catalog_info = object-store:swift:publicURL {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.496292 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] syslog_log_facility = LOG_USER {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.496395 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] target_helper = lioadm {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.496570 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] target_ip_address = 10.4.3.9 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.496697 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] target_port = 3260 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.496812 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.496960 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] target_protocol = iscsi {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.497079 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] target_secondary_ip_addresses = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.497180 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] trace_flags = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.497281 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.497387 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] transport_url = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.497515 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] until_refresh = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.497622 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] use_chap_auth = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.497713 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] use_default_quota_class = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.497816 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] use_journal = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.497913 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] use_json = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.498009 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] use_multipath_for_image_xfer = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.498106 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] use_stderr = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.498231 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] use_syslog = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.498346 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] verify_glance_signatures = enabled {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.498459 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.498591 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_api_class = cinder.volume.api.API {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.498717 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_backend_name = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.498820 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_clear = zero {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.498913 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_clear_ionice = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.499009 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_clear_size = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.499112 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.499209 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_copy_bps_limit = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.499305 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_dd_blocksize = 1M {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.499410 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.499534 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_name_template = volume-%s {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.499639 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_usage_audit_period = month {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.499766 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.499881 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_concurrency.disable_process_locking = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.499987 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.500148 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.500286 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.500400 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.500531 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.500664 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.500773 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.500883 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.500986 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.501096 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.auth_section = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.501236 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.auth_type = password {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.501345 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.auth_version = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.501460 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.cache = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.501597 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.501701 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.certfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.501804 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.501932 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.502049 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.502150 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.502283 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.include_service_catalog = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.502403 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.insecure = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.502543 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.interface = public {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.502672 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.keyfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.502784 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_password = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.502889 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.502989 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.503087 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.503187 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.503284 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.503417 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.503548 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.503657 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.503756 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.503852 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.503947 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.504045 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.504154 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.504276 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.504385 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_username = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.504520 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.504646 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.region_name = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.504764 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.504868 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.504966 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.service_type = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.505065 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.505168 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.www_authenticate_uri = https://10.4.3.9/identity {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.505280 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.backend = dogpile.cache.null {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.505386 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.backend_argument = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.505486 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.backend_expiration_time = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.505615 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.config_prefix = cache.oslo {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.505716 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.debug_cache_backend = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.505816 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.enable_retry_client = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.505914 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.enable_socket_keepalive = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.506013 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.506113 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.expiration_time = 600 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.506224 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.506325 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.hashclient_retry_attempts = 2 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.506432 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.506555 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.memcache_dead_retry = 300 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.506680 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.506784 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.506882 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.memcache_pool_maxsize = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.506996 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.507129 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.memcache_sasl_enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.507242 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.507348 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.password = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.507451 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.proxies = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.507580 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.redis_db = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.507685 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.507789 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.507891 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.redis_server = localhost:6379 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.507990 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.retry_attempts = 2 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.508092 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.retry_delay = 0.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.508191 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.socket_keepalive_count = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.508289 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.socket_keepalive_idle = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.508393 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.socket_keepalive_interval = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.508523 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.socket_timeout = 1.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.508650 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.tls_allowed_ciphers = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.508754 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.tls_cafile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.508853 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.tls_certfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.508953 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.tls_enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.509048 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.tls_keyfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.509147 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.username = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.509258 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] coordination.backend_url = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.509368 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.asyncio_connection = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.509463 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.asyncio_slave_connection = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.509589 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.backend = sqlalchemy {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.509694 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.connection = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.509795 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.connection_debug = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.509902 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.connection_parameters = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.510064 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.connection_recycle_time = 3600 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.510228 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.connection_trace = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.510338 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.db_inc_retry_interval = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.510441 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.db_max_retries = 20 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.510563 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.db_max_retry_interval = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.510685 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.db_retry_interval = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.510788 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.max_overflow = 50 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.510886 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.max_pool_size = 5 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.510992 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.max_retries = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.511087 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.511184 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.mysql_wsrep_sync_wait = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.511279 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.pool_timeout = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.511376 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.retry_interval = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.511467 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.slave_connection = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.511596 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.sqlite_synchronous = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.511700 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.synchronous_reader = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.511825 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.use_db_reconnect = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.511929 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.512056 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.512183 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.512294 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.512392 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.512678 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.connection_string = messaging:// {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.512774 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.512877 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.es_doc_type = notification {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.512977 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.es_scroll_size = 10000 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.513073 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.es_scroll_time = 2m {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.513169 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.filter_error_trace = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.513276 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.hmac_keys = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.513373 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.sentinel_service_name = mymaster {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.513482 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.socket_timeout = 0.1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.513606 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.trace_requests = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.513704 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.trace_sqlalchemy = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.513839 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler_jaeger.process_tags = {} {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.513943 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler_jaeger.service_name_prefix = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.514042 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler_otlp.service_name_prefix = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.514158 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.enforce_new_defaults = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.514465 np0000003683 cinder-backup[101221]: WARNING oslo_config.cfg [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 26 02:37:50.514753 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.enforce_scope = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.514919 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.policy_default_rule = default {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.515044 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.515203 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.policy_file = policy.yaml {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.515354 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.515531 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.515678 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.515820 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.515959 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.516105 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.516262 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.516403 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] privsep_osbrick.group = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.516571 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] privsep_osbrick.helper_command = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.516715 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.516863 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.517011 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] privsep_osbrick.thread_pool_size = 16 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.517147 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] privsep_osbrick.user = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.517290 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.517432 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_sys_admin.group = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.517596 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_sys_admin.helper_command = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.517738 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.517882 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.518020 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_sys_admin.thread_pool_size = 16 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.518151 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_sys_admin.user = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.518296 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.auth_section = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.518410 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.auth_type = password {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.519029 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.cafile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.519029 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.certfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.519029 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.collect_timing = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.519029 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.insecure = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.519029 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.keyfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.519220 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.send_service_user_token = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.519220 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.split_loggers = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.519269 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.timeout = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.519363 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.auth_section = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.519464 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.auth_type = password {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.519598 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.519728 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.certfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.519832 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.collect_timing = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.519929 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.insecure = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.520025 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.keyfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.520120 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.region_name = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.520217 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.split_loggers = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.520340 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.timeout = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.520420 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.backend_availability_zone = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.520554 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.chap_password = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.520669 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.chap_username = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.520772 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.520868 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.disk_geometry = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.520962 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.driver_client_cert = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.521056 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.driver_client_cert_key = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.521150 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.driver_data_namespace = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.521244 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.521340 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.521434 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.driver_use_ssl = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.521560 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.521694 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.521796 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.filter_function = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.521891 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.goodness_function = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.521987 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.522090 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.522213 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.522315 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.522412 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.522550 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.iscsi_target_flags = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.522668 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.iscsi_write_cache = on {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.522774 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.iser_helper = tgtadm {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.522930 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.iser_ip_address = 10.4.3.9 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.523036 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.iser_port = 3260 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.523148 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.523254 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.523353 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.523449 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.num_shell_tries = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.523575 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.523697 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.523796 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.523895 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.523992 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.replication_device = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.524088 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.report_discard_supported = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.524185 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.reserved_percentage = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.524289 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.524416 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.524553 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.524671 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.target_helper = tgtadm {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.524811 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.target_ip_address = 10.4.3.9 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.524914 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.target_port = 3260 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.525015 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.525117 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.target_protocol = iscsi {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.525220 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.525318 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.trace_flags = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.525414 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.unique_fqdn_network = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.525536 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.use_chap_auth = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.525666 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.525771 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.volume_backend_name = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.525875 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.volume_clear = zero {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.525972 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.volume_clear_ionice = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.526068 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.volume_clear_size = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.526173 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.526270 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.526368 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.526524 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.526632 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_reports.file_event_handler = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.526730 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.526825 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_reports.log_dir = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.526929 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.527027 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.527123 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.527223 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.527320 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.527417 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.527545 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.527668 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.527776 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.hostname = np0000003683 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.527871 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.527974 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.528073 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.528171 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.528269 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.528370 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.processname = cinder-backup {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.528467 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.528594 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.528697 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.528795 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.528891 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.528986 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.529083 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.529178 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.529272 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.529367 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.529464 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.529591 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.529718 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.529820 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.529919 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.ssl = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.530021 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.530122 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.530218 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.530313 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.530437 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.530548 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.530649 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.530752 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_notifications.driver = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.530850 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_notifications.retry = -1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.530956 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.531053 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.531161 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.531353 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.531455 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.barbican_api_version = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.531584 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.barbican_endpoint = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.531716 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.barbican_endpoint_type = public {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.531813 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.barbican_region_name = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.531910 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.cafile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.532006 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.certfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.532105 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.collect_timing = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.532226 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.insecure = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.532335 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.keyfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.532450 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.number_of_retries = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.532584 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.retry_delay = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.532683 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.send_service_user_token = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.532781 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.split_loggers = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.532898 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.timeout = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.533002 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.verify_ssl = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.533095 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.verify_ssl_path = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.533195 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.auth_section = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.533296 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.auth_type = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.533391 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.cafile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.533507 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.certfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.533626 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.collect_timing = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.533733 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.insecure = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.533830 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.keyfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.533926 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.split_loggers = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.534020 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.timeout = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.534119 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.approle_role_id = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.534214 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.approle_secret_id = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.534338 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.kv_mountpoint = secret {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.534429 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.kv_path = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.534575 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.kv_version = 2 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.534685 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.namespace = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.534812 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.root_token_id = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.534941 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.ssl_ca_crt_file = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.535045 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.timeout = 60.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.535143 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.use_ssl = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.535315 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.535399 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] ******************************************************************************** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 26 02:37:50.535601 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] Full set of CONF: {{(pid=101221) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:275}} Jun 26 02:37:50.535701 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] ******************************************************************************** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 26 02:37:50.535778 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] Configuration options gathered from: {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 26 02:37:50.535857 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 26 02:37:50.535963 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 26 02:37:50.536038 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] ================================================================================ {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 26 02:37:50.536164 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] allow_availability_zone_fallback = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.536256 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] allow_compression_on_image_upload = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.536349 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] allowed_direct_url_schemes = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.536438 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] api_rate_limit = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.536553 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] auth_strategy = keystone {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.536650 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backdoor_port = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.536737 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backdoor_socket = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.536824 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_availability_zone = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.536916 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_api_class = cinder.backup.api.API {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.537009 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_compression_algorithm = zlib {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.537097 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_create_containers = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.537190 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_driver = cinder.backup.drivers.swift.SwiftBackupDriver {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.537279 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_driver_init_check_interval = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.537369 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_driver_stats_polling_interval = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.537464 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.537583 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_max_operations = 15 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.537728 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_metadata_version = 2 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.537833 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_name_template = backup-%s {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.537924 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_native_threads_pool_size = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.538014 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_object_number_per_notification = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.538104 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_service_inithost_offload = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.538219 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_auth = per_user {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.538377 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_auth_insecure = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.538512 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_auth_url = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.538627 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_auth_version = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.538726 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_block_size = 32768 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.538827 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_ca_cert_file = /opt/stack/data/ca-bundle.pem {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.538925 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_container = volumebackups {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.539014 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_create_storage_policy = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.539105 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_enable_progress_timer = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.539192 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_key = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.539283 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_object_size = 52428800 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.539371 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_project = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.539456 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_project_domain = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.539570 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_region_name = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.539739 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_retry_attempts = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.539849 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_retry_backoff = 2 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.539946 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_service_auth = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.540040 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_tenant = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.540263 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_url = https://10.4.3.9:8080/v1/AUTH_ {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.540357 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_user = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.540451 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_swift_user_domain = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.540591 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_timer_interval = 120 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.540669 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_use_same_host = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.540778 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_use_temp_snapshot = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.540899 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backup_workers = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.541000 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] chap_password = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.541136 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] chap_username = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.541244 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.541346 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_internal_tenant_project_id = 1cd7b85680e34994885a309cbd63188e {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.541441 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_internal_tenant_user_id = b8f878f898b6405e8bb910ecab07a665 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.541566 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] compression_format = gzip {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.541664 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] config_dir = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.541742 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.541836 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] config_source = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.541929 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.542025 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] control_exchange = openstack {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.542168 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] debug = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.542263 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] default_availability_zone = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.542380 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] default_group_type = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.542548 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'swiftclient=WARN', 'botocore=WARN'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.542652 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] default_volume_type = storpool {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.542745 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] disk_geometry = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.542831 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] driver_client_cert = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.542919 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] driver_client_cert_key = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.543006 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] driver_data_namespace = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.543137 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] driver_ssl_cert_path = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.543236 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] driver_ssl_cert_verify = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.543327 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] driver_use_ssl = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.543415 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] enable_new_services = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.543531 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] enable_unsupported_driver = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.543637 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] enabled_backends = ['storpool'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.543728 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] enforce_multipath_for_image_xfer = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.543803 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] fatal_deprecations = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.543900 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] filter_function = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.543987 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_api_insecure = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.544121 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_api_servers = ['https://10.4.3.9/image'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.544229 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_api_ssl_compression = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.544325 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_ca_certificates_file = /opt/stack/data/ca-bundle.pem {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.544417 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_catalog_info = image:glance:publicURL {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.544553 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_certfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.544710 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.544807 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_keyfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.544898 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_num_retries = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.544987 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance_request_timeout = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.545105 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] goodness_function = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.545223 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] graceful_shutdown_timeout = 5 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.545321 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] group_api_class = cinder.group.api.API {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.545415 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] host = np0000003683 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.545528 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_compress_on_upload = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.545633 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_conversion_address_space_limit = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.545733 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_conversion_cpu_limit = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.545854 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.545942 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_conversion_disable = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.546031 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_upload_use_cinder_backend = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.546165 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_upload_use_internal_tenant = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.546260 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_volume_cache_enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.546349 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_volume_cache_max_count = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.546436 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] image_volume_cache_max_size_gb = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.546561 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] instance_format = [instance: %(uuid)s] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.546658 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.546750 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] iscsi_target_flags = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.546843 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] iscsi_write_cache = on {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.546933 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] iser_helper = tgtadm {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.547071 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] iser_ip_address = 10.4.3.9 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.547198 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] iser_port = 3260 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.547297 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.547403 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_catalog_info = identity:Identity Service:publicURL {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.547530 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_color = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.547656 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_config_append = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.547756 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.547847 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_dir = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.547938 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_file = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.548012 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_options = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.548361 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_rotate_interval = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.548361 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_rotate_interval_type = days {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.548361 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] log_rotation_type = none {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.548434 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.548533 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.548604 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.548699 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.548773 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.549042 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] max_age = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.549042 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] max_logfile_count = 30 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.549042 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] max_logfile_size_mb = 200 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.549174 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] max_over_subscription_ratio = 20.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.549269 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] message_reap_interval = 86400 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.549358 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] message_ttl = 2592000 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.549445 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] monkey_patch = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.549563 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] monkey_patch_modules = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.549663 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] my_ip = 10.4.3.9 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.549756 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] no_snapshot_gb_quota = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.549844 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] num_iser_scan_tries = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.549931 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] num_shell_tries = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.550024 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] num_volume_device_scan_tries = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.550116 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] nvmeof_conn_info_version = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.550206 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] nvmet_ns_id = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.550284 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] nvmet_port_id = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.550371 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] osapi_max_limit = 1000 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.550461 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] osapi_volume_ext_list = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.550592 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.550721 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.550783 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] osapi_volume_listen_port = 8776 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.550867 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] osapi_volume_use_ssl = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.550955 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] osapi_volume_workers = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.551042 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] per_volume_size_limit = -1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.551128 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] periodic_fuzzy_delay = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.551215 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] periodic_interval = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.551305 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.551392 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] public_endpoint = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.551493 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] publish_errors = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.551599 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] quota_backup_gigabytes = 1000 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.551715 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] quota_backups = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.551809 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.551898 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] quota_gigabytes = 1000 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.551986 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] quota_groups = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.552079 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] quota_snapshots = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.552175 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] quota_volumes = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.552264 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] rate_limit_burst = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.552392 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] rate_limit_except_level = CRITICAL {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.552549 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] rate_limit_interval = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.552683 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] replication_device = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.552814 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] report_discard_supported = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.552919 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] report_interval = 120 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.553036 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] reservation_clean_interval = 86400 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.553112 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] reservation_expire = 86400 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.553205 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] reserved_image_namespaces = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.553294 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] reserved_percentage = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.553386 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.553500 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.553618 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] rpc_response_timeout = 120 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.553721 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] run_external_periodic_tasks = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.553816 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.553910 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] scst_target_driver = iscsi {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.553995 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] scst_target_iqn_name = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.554087 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_down_time = 720 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.554175 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] shell_completion = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.554269 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] snapshot_name_template = snapshot-%s {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.554357 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] split_loggers = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.554430 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] state_path = /opt/stack/data/cinder {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.554557 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] storage_availability_zone = nova {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.554681 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] storage_protocol = iSCSI {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.554818 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] swift_catalog_info = object-store:swift:publicURL {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.554955 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] syslog_log_facility = LOG_USER {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.555055 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] target_helper = lioadm {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.555182 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] target_ip_address = 10.4.3.9 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.555275 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] target_port = 3260 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.555368 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.555463 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] target_protocol = iscsi {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.555611 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] target_secondary_ip_addresses = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.555707 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] trace_flags = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.555803 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.555895 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] transport_url = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.555985 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] until_refresh = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.556073 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] use_chap_auth = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.556160 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] use_default_quota_class = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.556250 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] use_journal = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.556340 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] use_json = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.556430 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] use_multipath_for_image_xfer = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.556545 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] use_stderr = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.556638 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] use_syslog = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.556734 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] verify_glance_signatures = enabled {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.556833 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.556926 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_api_class = cinder.volume.api.API {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.557012 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_backend_name = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.557105 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_clear = zero {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.557192 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_clear_ionice = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.557281 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_clear_size = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.557374 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.557461 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_copy_bps_limit = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.557580 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_dd_blocksize = 1M {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.557733 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.557828 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_name_template = volume-%s {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.557923 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volume_usage_audit_period = month {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.558041 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 02:37:50.558171 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_concurrency.disable_process_locking = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.558283 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.558487 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.558639 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.558740 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.558839 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.558932 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.559023 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.559124 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.559218 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.559316 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.auth_section = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.559414 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.auth_type = password {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.559534 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.auth_version = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.559645 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.cache = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.559743 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.559834 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.certfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.559925 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.560020 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.560110 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.560200 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.560289 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.include_service_catalog = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.560380 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.insecure = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.560483 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.interface = public {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.560591 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.keyfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.560686 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_password = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.560815 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.560864 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.560955 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.561043 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.561132 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.561223 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.561312 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.561407 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.561520 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.561624 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.561700 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.561797 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.561905 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.561998 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.562091 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcache_username = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.562195 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.562286 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.region_name = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.562385 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.562484 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.562594 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.service_type = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.562685 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.562780 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] keystone_authtoken.www_authenticate_uri = https://10.4.3.9/identity {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.562885 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.backend = dogpile.cache.null {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.562975 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.backend_argument = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.563066 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.backend_expiration_time = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.563162 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.config_prefix = cache.oslo {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.563251 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.debug_cache_backend = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.563340 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.enable_retry_client = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.563429 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.enable_socket_keepalive = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.563560 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.563671 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.expiration_time = 600 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.563772 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.563864 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.hashclient_retry_attempts = 2 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.563958 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.564049 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.memcache_dead_retry = 300 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.564139 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.564228 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.564318 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.memcache_pool_maxsize = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.564407 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.564526 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.memcache_sasl_enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.564631 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.564757 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.password = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.564860 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.proxies = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.564953 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.redis_db = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.565046 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.565144 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.565236 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.redis_server = localhost:6379 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.565321 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.retry_attempts = 2 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.565415 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.retry_delay = 0.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.565535 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.socket_keepalive_count = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.565660 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.socket_keepalive_idle = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.565764 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.socket_keepalive_interval = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.565862 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.socket_timeout = 1.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.565953 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.tls_allowed_ciphers = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.566043 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.tls_cafile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.566127 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.tls_certfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.566221 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.tls_enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.566310 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.tls_keyfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.566403 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cache.username = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.566551 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] coordination.backend_url = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.566637 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.asyncio_connection = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.566733 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.asyncio_slave_connection = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.566831 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.backend = sqlalchemy {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.566939 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.connection = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.567022 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.connection_debug = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.567142 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.connection_parameters = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.567252 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.connection_recycle_time = 3600 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.567368 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.connection_trace = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.567460 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.db_inc_retry_interval = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.567598 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.db_max_retries = 20 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.567719 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.db_max_retry_interval = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.567860 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.db_retry_interval = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.567960 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.max_overflow = 50 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.568050 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.max_pool_size = 5 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.568139 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.max_retries = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.568232 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.568329 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.mysql_wsrep_sync_wait = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.568412 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.pool_timeout = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.568534 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.retry_interval = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.568634 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.slave_connection = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.568717 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.sqlite_synchronous = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.568810 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.synchronous_reader = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.568976 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] database.use_db_reconnect = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.568976 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.569072 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.569163 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.569286 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.569547 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.569547 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.connection_string = messaging:// {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.569547 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.569764 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.es_doc_type = notification {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.569764 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.es_scroll_size = 10000 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.569929 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.es_scroll_time = 2m {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.569929 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.filter_error_trace = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.570083 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.hmac_keys = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.570237 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.sentinel_service_name = mymaster {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.570237 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.socket_timeout = 0.1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.570326 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.trace_requests = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.570424 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler.trace_sqlalchemy = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.570530 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler_jaeger.process_tags = {} {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.570614 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler_jaeger.service_name_prefix = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.570707 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] profiler_otlp.service_name_prefix = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.570812 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.enforce_new_defaults = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.570892 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.enforce_scope = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.571004 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.policy_default_rule = default {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.571056 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.571106 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.policy_file = policy.yaml {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.571176 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.571247 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.571318 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.571390 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.571461 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.571569 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.571671 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.571749 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] privsep_osbrick.group = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.571823 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] privsep_osbrick.helper_command = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.571896 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.571967 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.572039 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] privsep_osbrick.thread_pool_size = 16 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.572112 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] privsep_osbrick.user = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.572189 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.572260 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_sys_admin.group = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.572333 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_sys_admin.helper_command = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.572402 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.572472 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.572571 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_sys_admin.thread_pool_size = 16 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.572642 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] cinder_sys_admin.user = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.572719 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.auth_section = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.572791 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.auth_type = password {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.572862 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.cafile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.572933 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.certfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.573003 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.collect_timing = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.573072 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.insecure = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.573153 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.keyfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.573262 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.send_service_user_token = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.573342 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.split_loggers = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.573415 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] service_user.timeout = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.573515 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.auth_section = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.573594 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.auth_type = password {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.573689 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.573764 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.certfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.573835 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.collect_timing = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.573907 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.insecure = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.573978 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.keyfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.574049 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.region_name = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.574120 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.split_loggers = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.574191 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] glance.timeout = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.574274 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.backend_availability_zone = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.574346 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.chap_password = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.574417 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.chap_username = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.574512 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.574587 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.disk_geometry = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.574657 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.driver_client_cert = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.574730 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.driver_client_cert_key = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.574826 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.driver_data_namespace = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.574905 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.574979 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.575050 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.driver_use_ssl = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.575120 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.575190 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.575262 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.filter_function = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.575363 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.goodness_function = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.575454 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.575550 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.575648 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.575726 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.575799 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.575872 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.iscsi_target_flags = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.575945 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.iscsi_write_cache = on {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.576017 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.iser_helper = tgtadm {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.576088 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.iser_ip_address = 10.4.3.9 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.576158 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.iser_port = 3260 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.576229 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.576301 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.576372 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.576441 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.num_shell_tries = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.576537 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.576618 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.576682 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.576751 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.576821 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.replication_device = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.576892 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.report_discard_supported = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.576963 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.reserved_percentage = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.577033 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.577103 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.577174 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.577244 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.target_helper = tgtadm {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.577314 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.target_ip_address = 10.4.3.9 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.577383 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.target_port = 3260 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.577453 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.577548 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.target_protocol = iscsi {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.577644 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.577723 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.trace_flags = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.577796 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.unique_fqdn_network = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.577873 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.use_chap_auth = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.577985 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.578064 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.volume_backend_name = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.578137 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.volume_clear = zero {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.578210 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.volume_clear_ionice = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.578281 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.volume_clear_size = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.578352 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.578423 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.578518 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.578593 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.578670 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_reports.file_event_handler = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.578742 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.578812 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_reports.log_dir = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.578891 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.578963 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.579034 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.579105 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.579176 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.579246 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.579318 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.579388 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.579459 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.hostname = np0000003683 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.579563 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.579661 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.579738 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.579811 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.579883 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.579958 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.processname = cinder-backup {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.580078 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.580152 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.580225 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.580296 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.580367 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.580439 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.580536 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.580611 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.580683 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.580753 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.580823 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.580893 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.580962 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.581040 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.581103 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.ssl = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.581193 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.581247 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.581308 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.581378 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.581448 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.581543 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.581636 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.581722 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_notifications.driver = [] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.581796 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_notifications.retry = -1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.581868 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.581938 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.582014 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.582095 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.582173 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.barbican_api_version = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.582239 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.barbican_endpoint = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.582311 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.barbican_endpoint_type = public {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.582392 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.barbican_region_name = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.582487 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.cafile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.582588 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.certfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.582663 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.collect_timing = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.582735 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.insecure = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.582806 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.keyfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.582878 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.number_of_retries = 60 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.582949 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.retry_delay = 1 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.583019 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.send_service_user_token = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.583089 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.split_loggers = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.583158 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.timeout = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.583228 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.verify_ssl = True {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.583299 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican.verify_ssl_path = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.583374 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.auth_section = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.583445 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.auth_type = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.583545 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.cafile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.583641 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.certfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.583721 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.collect_timing = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.583794 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.insecure = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.583865 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.keyfile = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.583936 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.split_loggers = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.584007 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] barbican_service_user.timeout = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.584082 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.approle_role_id = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.584153 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.approle_secret_id = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.584222 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.kv_mountpoint = secret {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.584293 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.kv_path = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.584362 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.kv_version = 2 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.584433 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.namespace = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.584528 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.root_token_id = **** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.584601 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.ssl_ca_crt_file = None {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.584675 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.timeout = 60.0 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.584745 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.use_ssl = False {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.584817 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 02:37:50.584914 np0000003683 cinder-backup[101221]: DEBUG oslo_service.backend._eventlet.service [None req-64fe124a-cefb-42fc-ad24-1393d41905a5 None None] ******************************************************************************** {{(pid=101221) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 26 02:37:50.585151 np0000003683 cinder-backup[101221]: INFO cinder.service [-] Starting cinder-backup node (version 28.1.0) Jun 26 02:37:50.592802 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.lockutils [None req-fbf658ba-4ca8-4eca-9c04-842a7eb5eb7e None None] Acquiring lock "cleanup_incomplete_backups_101221" by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 02:37:50.593214 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.lockutils [None req-fbf658ba-4ca8-4eca-9c04-842a7eb5eb7e None None] Lock "cleanup_incomplete_backups_101221" acquired by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" :: waited 0.000s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 02:37:50.593311 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-fbf658ba-4ca8-4eca-9c04-842a7eb5eb7e None None] Cleaning up incomplete backup operations. Jun 26 02:37:50.605072 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.lockutils [None req-fbf658ba-4ca8-4eca-9c04-842a7eb5eb7e None None] Lock "cleanup_incomplete_backups_101221" "released" by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" :: held 0.012s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 02:37:50.634693 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-fbf658ba-4ca8-4eca-9c04-842a7eb5eb7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:37:50.639278 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-fbf658ba-4ca8-4eca-9c04-842a7eb5eb7e None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:37:50.644199 np0000003683 cinder-backup[101221]: INFO cinder.keymgr.migration [None req-f7685b2b-72e6-49df-85f5-784d935a44a1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 26 02:37:50.652018 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-fbf658ba-4ca8-4eca-9c04-842a7eb5eb7e None None] Creating RPC server for service cinder-backup {{(pid=101221) start /opt/stack/cinder/cinder/service.py:231}} Jun 26 02:37:50.655525 np0000003683 cinder-backup[101221]: DEBUG cinder.service [None req-fbf658ba-4ca8-4eca-9c04-842a7eb5eb7e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=101221) start /opt/stack/cinder/cinder/service.py:237}} Jun 26 02:38:00.654532 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=11,cinder:INSERT=1 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:39:12.674361 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:39:12.674919 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:40:00.678305 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:40:12.677255 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:40:12.677707 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:41:12.675693 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:41:12.676235 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:42:00.678403 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:42:12.679309 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:42:12.679903 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:43:12.683153 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:43:12.683598 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:43:33.203502 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Create backup started, backup: 1b917d1b-afb8-4b07-a806-3fc78a65e3c5 volume: 17293aec-1dcd-4048-a0be-43c6a61ca4a0 snapshot: e310aa99-b18b-4299-85ec-841d2d06e27a. Jun 26 02:43:33.207924 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumessnapshottestjson-backup-container-1921953',created_at=2026-06-26T02:43:33Z,data_timestamp=2026-06-26T02:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-152851952',encryption_key_id=None,fail_reason=None,host='np0000003683',id=1b917d1b-afb8-4b07-a806-3fc78a65e3c5,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='bac7218fd5ea43579f052f1bd83fe39b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id='e310aa99-b18b-4299-85ec-841d2d06e27a',status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='6a90f9b496904250a9167c7761ad6f7b',volume_id=17293aec-1dcd-4048-a0be-43c6a61ca4a0) Jun 26 02:43:33.279524 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_bac7218fd5ea43579f052f1bd83fe39b {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:43:33.282540 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:43:33.282540 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:43:33.282540 np0000003683 cinder-backup[101221]: INFO oslo.privsep.daemon [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpy25_hj_4/privsep.sock'] Jun 26 02:43:33.288926 np0000003683 sudo[120287]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpy25_hj_4/privsep.sock Jun 26 02:43:33.289548 np0000003683 sudo[120287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:43:33.566592 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 26 02:43:33.566592 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 26 02:43:33.566592 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 26 02:43:33.566592 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 02:43:33.566845 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 26 02:43:33.566845 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 26 02:43:33.566845 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 26 02:43:33.566994 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 02:43:33.566994 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 26 02:43:33.858273 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 26 02:43:33.858460 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 26 02:43:33.858607 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 26 02:43:33.858750 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 02:43:33.858865 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 26 02:43:33.858972 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 26 02:43:33.859077 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 26 02:43:33.859180 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 02:43:33.859289 np0000003683 cinder-backup[101221]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 26 02:43:34.042034 np0000003683 sudo[120287]: pam_unix(sudo:session): session closed for user root Jun 26 02:43:34.052164 np0000003683 cinder-backup[101221]: INFO oslo.privsep.daemon [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Spawned new privsep daemon via rootwrap Jun 26 02:43:34.052442 np0000003683 cinder-backup[101221]: DEBUG oslo.privsep.daemon [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Accepted privsep connection to /tmp/tmpy25_hj_4/privsep.sock {{(pid=101221) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 26 02:43:34.168780 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:43:34.172515 np0000003683 cinder-backup[101221]: WARNING os_brick.initiator.connectors.nvmeof [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Jun 26 02:43:34.192436 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:43:34.203686 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:43:34.204084 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:43:34.214359 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:43:34.216673 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:febf:32cc', 'fe80::f828:7bff:fef6:e12c', 'fe80::fc16:3eff:fe22:eca1', 'fe80::f836:8aff:fe92:95f1', 'fe80::fc16:3eff:fede:7661', 'fe80::fc16:3eff:fec6:5cb4', 'fe80::e879:ebff:fecc:9ff0', 'fe80::fc16:3eff:fe3c:6240', 'fe80::fc89:7eff:fecf:1b36', 'fe80::fc16:3eff:fe39:e337', 'fe80::7c71:b5ff:fef4:d135', 'fe80::fc16:3eff:fe8f:9341', 'fe80::54a3:a9ff:fe5a:4ca0'] Jun 26 02:43:34.216831 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:43:34.216972 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:43:34.217617 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] <== get_connector_properties: return (936ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:43:34.727959 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:43:34.728462 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9be834c-6000-4e4e-9437-cd8ea2ad53bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:43:34.728769 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:43:43.274760 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:43:44.626821 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 9.898s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:43:44.627788 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9be834c-6000-4e4e-9437-cd8ea2ad53bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:43:44.639404 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:43:44.639825 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:43:44.640047 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:43:44.654032 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:43:44.654032 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:43:44.665373 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc] added Jun 26 02:43:44.665373 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:43:44.665373 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:43:44.665373 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:43:44.665373 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:43:44.665373 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:43:44.665373 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:43:44.665860 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:43:44.666066 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:43:44.666259 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:43:45.667112 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:43:45.681428 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:43:45.683042 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:43:45.691374 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:43:45.705505 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash) Jun 26 02:43:45.705505 np0000003683 cinder-backup[101221]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash) Jun 26 02:43:45.705505 np0000003683 cinder-backup[101221]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash) Jun 26 02:43:45.705505 np0000003683 cinder-backup[101221]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash) Jun 26 02:43:45.705505 np0000003683 cinder-backup[101221]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash) Jun 26 02:43:45.705505 np0000003683 cinder-backup[101221]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash) Jun 26 02:43:45.705505 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:43:45.705505 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash) Jun 26 02:43:45.705505 np0000003683 cinder-backup[101221]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash) Jun 26 02:43:45.705505 np0000003683 cinder-backup[101221]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash) Jun 26 02:43:45.705505 np0000003683 cinder-backup[101221]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash) Jun 26 02:43:45.705505 np0000003683 cinder-backup[101221]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash) Jun 26 02:43:45.705505 np0000003683 cinder-backup[101221]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash) Jun 26 02:43:45.706229 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:43:45.742837 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc, portal: 192.168.40.100,3260] Jun 26 02:43:45.742837 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc, portal: 192.168.40.100,3260] successful. Jun 26 02:43:45.742837 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:43:45.757220 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:43:45.771844 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash) Jun 26 02:43:45.771844 np0000003683 cinder-backup[101221]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash) Jun 26 02:43:45.771844 np0000003683 cinder-backup[101221]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash) Jun 26 02:43:45.771844 np0000003683 cinder-backup[101221]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash) Jun 26 02:43:45.771844 np0000003683 cinder-backup[101221]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash) Jun 26 02:43:45.771844 np0000003683 cinder-backup[101221]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash) Jun 26 02:43:45.771844 np0000003683 cinder-backup[101221]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash) Jun 26 02:43:45.771844 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:43:45.772196 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash) Jun 26 02:43:45.772196 np0000003683 cinder-backup[101221]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed6c2a6b-4dc9-4d9d-9c5a-e047e2a37a3d (non-flash) Jun 26 02:43:45.772196 np0000003683 cinder-backup[101221]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash) Jun 26 02:43:45.772196 np0000003683 cinder-backup[101221]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash) Jun 26 02:43:45.772196 np0000003683 cinder-backup[101221]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash) Jun 26 02:43:45.772196 np0000003683 cinder-backup[101221]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash) Jun 26 02:43:45.772196 np0000003683 cinder-backup[101221]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash) Jun 26 02:43:45.772196 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:43:45.772501 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:43:45.772696 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:43:45.774670 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] HCTL ('7', '-', '-', 0) found on session 43 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:43:45.774856 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:43:45.794832 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Searching for a device in session 43 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:43:45.794832 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9be834c-6000-4e4e-9437-cd8ea2ad53bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:43:46.797800 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.171s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:43:46.798236 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] <== connect_volume: return (12069ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798952', 'path': '/dev/sdb'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:43:46.800497 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:43:46.816010 np0000003683 sudo[121106]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jun 26 02:43:46.816708 np0000003683 sudo[121106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:43:47.196599 np0000003683 sudo[121106]: pam_unix(sudo:session): session closed for user root Jun 26 02:43:47.198902 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.400s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:43:47.239693 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:43:47.248499 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] _create_container started, container: tempest-volumessnapshottestjson-backup-container-1921953,backup: 1b917d1b-afb8-4b07-a806-3fc78a65e3c5. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:43:47.510283 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] generate_object_name_prefix: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5 {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:43:47.522120 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] starting backup of volume: 17293aec-1dcd-4048-a0be-43c6a61ca4a0, volume size: 1073741824, object names prefix volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:43:47.771732 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:48.044097 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:48.044097 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:48.200521 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:48.200521 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:48.478880 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:48.748419 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:48.748575 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:48.885372 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:48.885372 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:49.100629 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:49.386892 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:49.387070 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:49.523209 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:49.523209 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:49.773433 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:50.043523 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:50.043523 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:50.149833 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:50.150255 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:50.359101 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:50.881905 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:50.882101 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:51.009862 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:51.010080 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:51.250256 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:51.505762 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:51.505969 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:51.638772 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:51.639013 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:51.830696 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:52.079203 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:52.079385 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:52.213527 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:52.213727 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:52.486671 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:52.749669 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:52.749871 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:52.878062 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:52.878771 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:53.110263 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:53.389123 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:53.389382 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:53.494312 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:53.494901 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:53.692832 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:53.948634 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:53.948860 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:54.053639 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:54.053799 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:54.245029 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:54.512897 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:54.513271 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:54.629374 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:54.629568 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:54.849271 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:55.112994 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:55.112994 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:55.223662 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:55.223662 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:55.431263 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:55.681175 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:55.681175 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:55.786906 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:55.787128 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:55.971268 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:56.233815 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:56.233993 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:56.332872 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:56.332872 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:56.534415 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:56.778736 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:56.779292 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:56.879020 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:56.879220 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:57.073160 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:57.338759 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:57.338759 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:57.441256 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:57.441417 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:57.636899 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:57.885022 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:57.885451 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:57.988090 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:57.988290 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:58.175696 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:58.417377 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:58.417631 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:58.521319 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:58.521319 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:58.721908 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:58.976387 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:58.976914 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:59.088658 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:59.088798 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:59.306146 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:59.565519 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:59.565688 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:43:59.679496 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:43:59.679693 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:43:59.811765 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:43:59.944368 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:43:59.944563 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:44:00.020270 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup MD5 for volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:44:00.020780 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:44:00.037492 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:44:00.044500 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:44:00.045019 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:44:00.054622 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:44:00.054981 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:44:00.060003 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:44:00.060308 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] _write_sha256file started, container name: tempest-volumessnapshottestjson-backup-container-1921953, sha256file filename: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:44:00.118455 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:44:00.119436 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] _write_metadata started, container name: tempest-volumessnapshottestjson-backup-container-1921953, metadata filename: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:44:00.144349 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "1b917d1b-afb8-4b07-a806-3fc78a65e3c5",\n "backup_name": "tempest-VolumesSnapshotTestJSON-Backup-152851952",\n "created_at": "2026-06-26 02:43:33+00:00",\n "objects": [\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "17293aec-1dcd-4048-a0be-43c6a61ca4a0",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"17293aec-1dcd-4048-a0be-43c6a61ca4a0\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"6a90f9b496904250a9167c7761ad6f7b\\", \\"project_id\\": \\"bac7218fd5ea43579f052f1bd83fe39b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"available\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:43:31.000000\\", \\"launched_at\\": \\"2026-06-26T02:43:31.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesSnapshotTestJSON-Volume-273636721\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": null, \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:43:31.000000\\", \\"updated_at\\": \\"2026-06-26T02:43:31.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:44:00.149387 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] backup 1b917d1b-afb8-4b07-a806-3fc78a65e3c5 finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:44:00.275000 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:44:00.291428 np0000003683 sudo[122022]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jun 26 02:44:00.292072 np0000003683 sudo[122022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:44:00.586109 np0000003683 sudo[122022]: pam_unix(sudo:session): session closed for user root Jun 26 02:44:00.588200 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.313s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:44:00.588881 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9be834c-6000-4e4e-9437-cd8ea2ad53bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798952', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:44:00.589077 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:44:01.745737 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.156s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:44:01.746336 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9be834c-6000-4e4e-9437-cd8ea2ad53bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:44:01.757499 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:44:01.758226 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:44:01.758226 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:44:01.758226 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:44:01.758499 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:44:01.781233 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] iscsiadm ('-m', 'session'): stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash) Jun 26 02:44:01.781233 np0000003683 cinder-backup[101221]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash) Jun 26 02:44:01.781233 np0000003683 cinder-backup[101221]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash) Jun 26 02:44:01.781233 np0000003683 cinder-backup[101221]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash) Jun 26 02:44:01.781233 np0000003683 cinder-backup[101221]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash) Jun 26 02:44:01.781233 np0000003683 cinder-backup[101221]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash) Jun 26 02:44:01.781233 np0000003683 cinder-backup[101221]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash) Jun 26 02:44:01.781233 np0000003683 cinder-backup[101221]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash) Jun 26 02:44:01.781233 np0000003683 cinder-backup[101221]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash) Jun 26 02:44:01.781233 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:44:01.783159 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] iscsi session list stdout=tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash) Jun 26 02:44:01.783159 np0000003683 cinder-backup[101221]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a (non-flash) Jun 26 02:44:01.783159 np0000003683 cinder-backup[101221]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash) Jun 26 02:44:01.783159 np0000003683 cinder-backup[101221]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4 (non-flash) Jun 26 02:44:01.783159 np0000003683 cinder-backup[101221]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc (non-flash) Jun 26 02:44:01.783159 np0000003683 cinder-backup[101221]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash) Jun 26 02:44:01.783159 np0000003683 cinder-backup[101221]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182 (non-flash) Jun 26 02:44:01.783159 np0000003683 cinder-backup[101221]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash) Jun 26 02:44:01.783159 np0000003683 cinder-backup[101221]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6 (non-flash) Jun 26 02:44:01.783159 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:44:01.783805 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ce3e522-86e4-4a24-816c-59b9f9db1e9a', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3503bbb3-d5d3-4d48-8244-7830266b9ad4', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-685e3e90-c453-499b-9807-d2eb1d4b3182', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0198da8f-ce4a-4b0f-a0a2-365b8ba08ec6', '47')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:44:01.783983 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc', '43')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:44:01.786085 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Resulting device map defaultdict(. at 0x79db78fb7380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc'): ({'sdb'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:44:01.786782 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Removing single pathed devices sdb {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:44:01.801540 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Flushing IO for device /dev/sdb {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:44:01.810444 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:44:01.863989 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:44:01.864151 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] SCSI volumes sdb have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:44:01.867273 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:44:01.881076 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:44:01.881076 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:44:01.894224 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:44:01.930082 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc, portal: 192.168.40.100,3260] Jun 26 02:44:01.930082 np0000003683 cinder-backup[101221]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-b9be834c-6000-4e4e-9437-cd8ea2ad53bc, portal: 192.168.40.100,3260] successful. Jun 26 02:44:01.930082 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:44:01.953039 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:44:01.953349 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.208s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:44:01.953550 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] <== disconnect_volume: return (1364ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:44:02.997501 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-4ab2c762-611b-4340-b5e5-0902584e6563 tempest-VolumesSnapshotTestJSON-670786988 None] Create backup finished. backup: 1b917d1b-afb8-4b07-a806-3fc78a65e3c5. Jun 26 02:44:03.958750 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] Delete backup started, backup: 1b917d1b-afb8-4b07-a806-3fc78a65e3c5. Jun 26 02:44:03.963592 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_bac7218fd5ea43579f052f1bd83fe39b {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:44:03.964504 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:44:03.964504 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] delete started, backup: 1b917d1b-afb8-4b07-a806-3fc78a65e3c5, container: tempest-volumessnapshottestjson-backup-container-1921953, prefix: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:44:04.014466 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] generated object list: ['volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00001', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00002', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00003', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00004', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00005', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00006', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00007', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00008', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00009', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00010', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00011', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00012', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00013', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00014', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00015', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00016', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00017', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00018', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00019', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00020', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00021', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5_metadata', 'volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:44:04.045293 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00001 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.066114 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00002 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.087864 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00003 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.107073 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00004 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.126259 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00005 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.146424 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00006 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.167568 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00007 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.188430 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00008 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.208964 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00009 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.230892 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00010 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.254637 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00011 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.278887 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00012 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.299359 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00013 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.322774 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00014 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.344732 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00015 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.363777 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00016 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.384626 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00017 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.403141 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00018 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.425733 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00019 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.449232 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00020 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.467318 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5-00021 in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.483148 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5_metadata in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.611082 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] deleted object: volume_17293aec-1dcd-4048-a0be-43c6a61ca4a0/20260626024347/az_nova_backup_1b917d1b-afb8-4b07-a806-3fc78a65e3c5_sha256file in container: tempest-volumessnapshottestjson-backup-container-1921953. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:44:04.611082 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] delete 1b917d1b-afb8-4b07-a806-3fc78a65e3c5 finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:44:04.645420 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:44:04.666116 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] Created reservations ['f87f8106-89af-497b-8d18-e6df74da5e03', '771caf2d-98e0-424a-9c76-04573cd6c7d6'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:44:04.685700 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-c3009568-0ad2-4e64-9a97-afc6b0bbcb4b tempest-VolumesSnapshotTestJSON-670786988 None] Delete backup finished, backup 1b917d1b-afb8-4b07-a806-3fc78a65e3c5 deleted. Jun 26 02:44:12.687053 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:44:12.687599 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:44:14.684757 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=38,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:45:12.684945 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:45:12.685333 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:46:00.677990 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:46:12.684197 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:46:12.684812 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:47:12.682971 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:47:12.683527 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:48:00.686672 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:48:12.687140 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:48:12.687759 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:48:24.422113 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Create backup started, backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. Jun 26 02:48:24.426848 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-06-26T02:48:24Z,data_timestamp=2026-06-26T02:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1593629144',encryption_key_id=None,fail_reason=None,host='np0000003683',id=cff84868-8f5b-4bdb-8963-fd7d625a3b8e,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='7a0a7fdd73fc40328c4c73ef53edc697',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='6abcc90720de4d3e8d49aa5c4bb02b11',volume_id=0967a30f-0598-4fc6-b866-0b8f4010402d) Jun 26 02:48:24.447508 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_7a0a7fdd73fc40328c4c73ef53edc697 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:48:24.447654 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:48:24.447899 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:48:24.455764 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:48:24.476494 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:48:24.486330 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:48:24.486661 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:48:24.493346 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:48:24.495539 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::2c1d:27ff:fe1e:8bcc', 'fe80::fc16:3eff:fede:902e', 'fe80::fc16:3eff:fee5:787d', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe41:f96f', 'fe80::2ce3:a1ff:fe2c:c865', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe07:6d30', 'fe80::4894:fff:fe8b:ae5b', 'fe80::fc16:3eff:fe18:269'] Jun 26 02:48:24.495539 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:48:24.495539 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:48:24.495539 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] <== get_connector_properties: return (47ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:48:25.000239 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:48:25.000239 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0967a30f-0598-4fc6-b866-0b8f4010402d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:48:25.000239 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:48:28.678780 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.679s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:48:28.679256 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0967a30f-0598-4fc6-b866-0b8f4010402d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:48:28.697367 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:48:28.697800 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:48:28.698134 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:48:28.709993 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:48:28.709993 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:28.724362 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d] added Jun 26 02:48:28.724362 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:48:28.724362 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:48:28.724362 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:48:28.724362 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:48:28.724362 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:48:28.724362 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:28.724669 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:48:28.724934 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:48:28.725174 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:48:29.729508 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:48:29.744370 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:29.760245 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:29.779452 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:29.779452 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:29.779452 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:29.779452 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:29.779452 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:29.779452 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:29.779452 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:29.779452 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:29.779452 np0000003683 cinder-backup[101221]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash) Jun 26 02:48:29.779452 np0000003683 cinder-backup[101221]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash) Jun 26 02:48:29.779452 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:48:29.779864 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:29.779864 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:29.779864 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:29.779864 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:29.779864 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:29.779864 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:29.779864 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:29.779864 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:29.779864 np0000003683 cinder-backup[101221]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash) Jun 26 02:48:29.779864 np0000003683 cinder-backup[101221]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash) Jun 26 02:48:29.779864 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:48:29.835373 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d, portal: 192.168.40.100,3260] Jun 26 02:48:29.835373 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d, portal: 192.168.40.100,3260] successful. Jun 26 02:48:29.835373 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:29.847190 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:29.866150 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:29.866150 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:29.866150 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:29.866150 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:29.866150 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:29.866150 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:29.866150 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:29.866150 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:29.866150 np0000003683 cinder-backup[101221]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash) Jun 26 02:48:29.866150 np0000003683 cinder-backup[101221]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash) Jun 26 02:48:29.866150 np0000003683 cinder-backup[101221]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash) Jun 26 02:48:29.866150 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:48:29.866686 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:29.866686 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:29.866686 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:29.866686 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:29.866686 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:29.866686 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:29.866686 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:29.866686 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:29.866686 np0000003683 cinder-backup[101221]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash) Jun 26 02:48:29.866686 np0000003683 cinder-backup[101221]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652a3fc3-2e76-4021-8c96-ec8fe9fac8e6 (non-flash) Jun 26 02:48:29.866686 np0000003683 cinder-backup[101221]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash) Jun 26 02:48:29.866686 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:48:29.866686 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:48:29.867135 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:48:29.868451 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] HCTL ('17', '-', '-', 0) found on session 98 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:48:29.868451 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Scanning host 17 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:48:29.886561 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Searching for a device in session 98 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:48:29.886804 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0967a30f-0598-4fc6-b866-0b8f4010402d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:48:30.895499 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.214s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:48:30.895499 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] <== connect_volume: return (5893ms) {'type': 'block', 'scsi_wwn': '3300000008ebd85f7', 'path': '/dev/sdl'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:48:30.895499 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdl {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:48:30.910718 np0000003683 sudo[136552]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdl Jun 26 02:48:30.911364 np0000003683 sudo[136552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:48:31.262073 np0000003683 sudo[136552]: pam_unix(sudo:session): session closed for user root Jun 26 02:48:31.267687 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdl" returned: 0 in 0.370s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:48:31.310106 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:48:31.318188 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] _create_container started, container: volumebackups,backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:48:31.457994 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] generate_object_name_prefix: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:48:31.462628 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] starting backup of volume: 0967a30f-0598-4fc6-b866-0b8f4010402d, volume size: 1073741824, object names prefix volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:48:31.638728 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:31.908189 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:31.908584 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:32.018995 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:32.019597 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:32.217559 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:32.458447 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:32.458447 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:32.587901 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:32.588237 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:32.824948 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:33.108459 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:33.109373 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:33.235816 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:33.236039 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:33.451681 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:33.718354 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:33.719491 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:33.852006 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:33.852172 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:34.052498 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:34.323565 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:34.324381 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:34.456639 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:34.456779 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:34.678098 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:34.931625 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:34.932183 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:35.060007 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:35.060490 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:35.295040 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:35.537386 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:35.537790 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:35.642057 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:35.642057 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:35.849935 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:36.106377 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:36.106573 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:36.208052 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:36.208275 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:36.423654 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:36.681223 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:36.681223 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:36.805597 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:36.805597 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:37.014055 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:37.268955 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:37.268955 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:37.376866 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:37.377063 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:37.583932 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:37.831256 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:37.831762 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:37.964060 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:37.964060 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:38.159676 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:38.426678 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:38.426821 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:38.539414 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:38.540740 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:38.741028 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:39.003018 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:39.003408 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:39.115082 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:39.115251 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:39.341788 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:39.588024 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:39.588152 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:39.695202 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:39.695392 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:39.898728 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:40.180355 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:40.180800 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:40.296864 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:40.297082 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:40.523076 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:40.803651 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:40.803871 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:40.934661 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:40.934820 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:41.187948 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:41.472628 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:41.472803 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:41.603705 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:41.603865 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:41.819827 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:42.070906 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:42.071109 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:42.191692 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:42.192146 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:42.439087 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:42.698282 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:42.698558 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:42.809343 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:42.809343 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:43.020393 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:43.310870 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:43.311250 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:43.421723 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:43.421918 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:43.520700 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:48:43.655909 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:48:43.655909 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:48:43.719454 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:48:43.719454 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:48:43.726909 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:48:43.732519 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:48:43.732796 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:48:43.738552 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:48:43.738552 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:48:43.742499 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:48:43.742499 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:48:43.817904 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:48:43.819200 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] _write_metadata started, container name: volumebackups, metadata filename: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:48:43.853436 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "cff84868-8f5b-4bdb-8963-fd7d625a3b8e",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1593629144",\n "created_at": "2026-06-26 02:48:24+00:00",\n "objects": [\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "0967a30f-0598-4fc6-b866-0b8f4010402d",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"0967a30f-0598-4fc6-b866-0b8f4010402d\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"6abcc90720de4d3e8d49aa5c4bb02b11\\", \\"project_id\\": \\"7a0a7fdd73fc40328c4c73ef53edc697\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:48:23.000000\\", \\"launched_at\\": \\"2026-06-26T02:48:23.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1315030099\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:48:23.000000\\", \\"updated_at\\": \\"2026-06-26T02:48:24.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:48:43.862884 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] backup cff84868-8f5b-4bdb-8963-fd7d625a3b8e finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:48:43.999414 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdl {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:48:44.019170 np0000003683 sudo[137033]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdl Jun 26 02:48:44.019828 np0000003683 sudo[137033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:48:44.311805 np0000003683 sudo[137033]: pam_unix(sudo:session): session closed for user root Jun 26 02:48:44.313908 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdl" returned: 0 in 0.314s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:48:44.314603 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0967a30f-0598-4fc6-b866-0b8f4010402d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000008ebd85f7', 'path': '/dev/sdl'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:48:44.314807 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:48:44.315347 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:48:44.316008 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0967a30f-0598-4fc6-b866-0b8f4010402d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:48:44.326954 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:48:44.327607 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:48:44.327607 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:48:44.327607 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:48:44.327607 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:48:44.351705 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:44.351705 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:44.351705 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:44.351705 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:44.351705 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:44.351705 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:44.351705 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:44.351705 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:44.351705 np0000003683 cinder-backup[101221]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash) Jun 26 02:48:44.351705 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:48:44.351933 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:44.351933 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:44.351933 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:44.351933 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:44.351933 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:44.351933 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:44.351933 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:44.351933 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:44.351933 np0000003683 cinder-backup[101221]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash) Jun 26 02:48:44.351933 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:48:44.352274 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d', '98')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:48:44.352408 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d', '98')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:48:44.353448 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Resulting device map defaultdict(. at 0x79db791c1080>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d'): ({'sdl'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:48:44.354747 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Removing single pathed devices sdl {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:48:44.365048 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Flushing IO for device /dev/sdl {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:48:44.372341 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:48:44.414134 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Checking to see if SCSI volumes sdl have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:48:44.414459 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] SCSI volumes sdl have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:48:44.415728 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Checking to see if device paths {'sdl'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:48:44.424990 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Device paths {'sdl'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:48:44.425212 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:48:44.435315 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:44.469015 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 98, target: iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d, portal: 192.168.40.100,3260] Jun 26 02:48:44.469015 np0000003683 cinder-backup[101221]: Logout of [sid: 98, target: iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d, portal: 192.168.40.100,3260] successful. Jun 26 02:48:44.469015 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:44.494191 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:44.494561 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.179s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:48:44.494749 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] <== disconnect_volume: return (180ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:48:45.516375 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-228a9673-3abe-4ae7-8376-f2057fed10c3 tempest-VolumesBackupsTest-232973889 None] Create backup finished. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e. Jun 26 02:48:45.964509 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Restore backup started, backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. Jun 26 02:48:45.974032 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_7a0a7fdd73fc40328c4c73ef53edc697 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:48:45.974175 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:48:45.974547 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:48:45.984999 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:48:46.006019 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:48:46.020190 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:48:46.020570 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:48:46.028868 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:48:46.030175 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe07:6d30', 'fe80::4894:fff:fe8b:ae5b', 'fe80::fc16:3eff:fe18:269', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c'] Jun 26 02:48:46.030378 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:48:46.030447 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:48:46.030710 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] <== get_connector_properties: return (55ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:48:47.040367 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:48:47.040367 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0967a30f-0598-4fc6-b866-0b8f4010402d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:48:47.043826 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:48:47.043826 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:48:47.043826 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0967a30f-0598-4fc6-b866-0b8f4010402d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:48:47.057045 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:48:47.057280 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:48:47.057525 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:48:47.070374 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:48:47.070374 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:47.082103 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d] added Jun 26 02:48:47.082103 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:48:47.082103 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:48:47.082103 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:48:47.082103 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:48:47.082103 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:48:47.082103 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:47.082415 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:48:47.082744 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:48:47.082958 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:48:48.083924 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:48:48.094380 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:48.105623 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:48.119256 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:48.119256 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:48.119256 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:48.119256 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:48.119256 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:48.119256 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:48.119256 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:48.119256 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:48.119256 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:48:48.119523 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:48.119523 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:48.119523 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:48.119523 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:48.119523 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:48.119523 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:48.119523 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:48.119523 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:48.119523 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:48:48.167130 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d, portal: 192.168.40.100,3260] Jun 26 02:48:48.167130 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d, portal: 192.168.40.100,3260] successful. Jun 26 02:48:48.167130 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:48.177360 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:48.195859 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:48.195859 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:48.195859 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:48.195859 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:48.195859 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:48.195859 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:48.195859 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:48.195859 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:48.195859 np0000003683 cinder-backup[101221]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash) Jun 26 02:48:48.195859 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:48:48.196142 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:48.196142 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:48.196142 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:48.196142 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:48.196142 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:48.196142 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:48.196142 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:48.196142 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:48.196142 np0000003683 cinder-backup[101221]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash) Jun 26 02:48:48.196142 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:48:48.196561 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:48:48.196749 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:48:48.197985 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] HCTL ('15', '-', '-', 0) found on session 99 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:48:48.198196 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Scanning host 15 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:48:48.211110 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Searching for a device in session 99 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:48:48.211110 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0967a30f-0598-4fc6-b866-0b8f4010402d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:48:49.215781 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.174s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:48:49.216218 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] <== connect_volume: return (2175ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799019', 'path': '/dev/sdj'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:48:49.216458 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:48:49.243135 np0000003683 sudo[137184]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj Jun 26 02:48:49.243980 np0000003683 sudo[137184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:48:49.591198 np0000003683 sudo[137184]: pam_unix(sudo:session): session closed for user root Jun 26 02:48:49.593279 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj" returned: 0 in 0.376s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:48:49.593705 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] starting restore of backup volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e container: volumebackups, to existing volume 0967a30f-0598-4fc6-b866-0b8f4010402d, backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e. {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jun 26 02:48:49.593859 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] _read_metadata started, container name: volumebackups, metadata filename: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e_metadata. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] _read_metadata finished. Metadata: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "backup_description": null, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "backup_id": "cff84868-8f5b-4bdb-8963-fd7d625a3b8e", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "backup_name": "tempest-VolumesBackupsTest-Backup-1593629144", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "created_at": "2026-06-26 02:48:24+00:00", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "objects": [ Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00001": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 0 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00002": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 52428800 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00003": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 104857600 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00004": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 157286400 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00005": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 209715200 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00006": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 262144000 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00007": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 314572800 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00008": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 367001600 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00009": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 419430400 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00010": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 471859200 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00011": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 524288000 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00012": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 576716800 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00013": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 629145600 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00014": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 681574400 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00015": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 734003200 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00016": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 786432000 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00017": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 838860800 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00018": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 891289600 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00019": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 943718400 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00020": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 996147200 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00021": { Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "length": 25165824, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "offset": 1048576000 Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: ], Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "parent_id": null, Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "version": "1.0.0", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_id": "0967a30f-0598-4fc6-b866-0b8f4010402d", Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"0967a30f-0598-4fc6-b866-0b8f4010402d\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"6abcc90720de4d3e8d49aa5c4bb02b11\", \"project_id\": \"7a0a7fdd73fc40328c4c73ef53edc697\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000003683@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-06-26T02:48:23.000000\", \"launched_at\": \"2026-06-26T02:48:23.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-1315030099\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"268cd356-e153-49dd-857f-2ea5794ac5be\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"26cf225a-ef51-42c6-990c-f9523cca3d45\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-06-26T02:48:23.000000\", \"updated_at\": \"2026-06-26T02:48:24.000000\"}}" Jun 26 02:48:49.614089 np0000003683 cinder-backup[101221]: }. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jun 26 02:48:49.617718 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Restoring backup version 1.0.0 {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jun 26 02:48:49.617718 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] _read_metadata started, container name: volumebackups, metadata filename: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e_metadata. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] _read_metadata finished. Metadata: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "backup_description": null, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "backup_id": "cff84868-8f5b-4bdb-8963-fd7d625a3b8e", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "backup_name": "tempest-VolumesBackupsTest-Backup-1593629144", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "created_at": "2026-06-26 02:48:24+00:00", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "objects": [ Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00001": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 0 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00002": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 52428800 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00003": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 104857600 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00004": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 157286400 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00005": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 209715200 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00006": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 262144000 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00007": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 314572800 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00008": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 367001600 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00009": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 419430400 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00010": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 471859200 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00011": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 524288000 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00012": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 576716800 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00013": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 629145600 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00014": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 681574400 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00015": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 734003200 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00016": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 786432000 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00017": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 838860800 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00018": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 891289600 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00019": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 943718400 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00020": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 996147200 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00021": { Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "length": 25165824, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "offset": 1048576000 Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: } Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: ], Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "parent_id": null, Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "version": "1.0.0", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_id": "0967a30f-0598-4fc6-b866-0b8f4010402d", Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"0967a30f-0598-4fc6-b866-0b8f4010402d\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"6abcc90720de4d3e8d49aa5c4bb02b11\", \"project_id\": \"7a0a7fdd73fc40328c4c73ef53edc697\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000003683@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-06-26T02:48:23.000000\", \"launched_at\": \"2026-06-26T02:48:23.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-1315030099\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"268cd356-e153-49dd-857f-2ea5794ac5be\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"26cf225a-ef51-42c6-990c-f9523cca3d45\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-06-26T02:48:23.000000\", \"updated_at\": \"2026-06-26T02:48:24.000000\"}}" Jun 26 02:48:49.631177 np0000003683 cinder-backup[101221]: }. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jun 26 02:48:49.636285 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] v1 volume backup restore of cff84868-8f5b-4bdb-8963-fd7d625a3b8e started. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jun 26 02:48:49.636285 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] metadata_object_names = ['volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00001', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00002', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00003', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00004', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00005', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00006', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00007', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00008', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00009', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00010', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00011', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00012', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00013', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00014', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00015', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00016', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00017', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00018', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00019', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00020', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00021']. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jun 26 02:48:49.680654 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] generated object list: ['volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00001', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00002', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00003', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00004', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00005', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00006', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00007', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00008', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00009', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00010', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00011', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00012', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00013', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00014', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00015', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00016', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00017', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00018', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00019', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00020', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00021', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e_metadata', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:48:49.719974 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:48:49.724284 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00001, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:49.739553 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:50.091515 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00002, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:50.110115 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:50.510442 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00003, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:50.532820 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:50.915774 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00004, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:50.931343 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:51.309197 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00005, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:51.324559 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:51.742623 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00006, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:51.766593 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:52.179168 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00007, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:52.204667 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:52.647117 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00008, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:52.666627 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:53.078738 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00009, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:53.100216 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:53.487974 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00010, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:53.503715 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:53.900235 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00011, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:53.916072 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:54.304704 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00012, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:54.323388 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:54.716303 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00013, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:54.738140 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:55.150230 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00014, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:55.165354 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:55.560099 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00015, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:55.574984 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:55.984031 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00016, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:56.003596 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:56.453542 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00017, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:56.468150 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:56.907410 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00018, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:56.922770 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:57.328624 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00019, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:57.343000 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:57.757429 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00020, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:57.772941 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:58.191524 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restoring object. backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, object name: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00021, volume: 0967a30f-0598-4fc6-b866-0b8f4010402d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:48:58.207455 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:48:58.406501 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] v1 volume backup restore of cff84868-8f5b-4bdb-8963-fd7d625a3b8e finished. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jun 26 02:48:58.406749 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Restoring volume base metadata {{(pid=101221) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jun 26 02:48:58.414336 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Excluding field 'display_name' {{(pid=101221) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jun 26 02:48:58.415241 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Excluding field 'display_description' {{(pid=101221) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jun 26 02:48:58.422960 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] No metadata of type 'volume-metadata' to restore {{(pid=101221) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jun 26 02:48:58.423107 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101221) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jun 26 02:48:58.423265 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] restore cff84868-8f5b-4bdb-8963-fd7d625a3b8e to 0967a30f-0598-4fc6-b866-0b8f4010402d finished. {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jun 26 02:48:58.641812 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:48:58.660368 np0000003683 sudo[137495]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj Jun 26 02:48:58.661068 np0000003683 sudo[137495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:48:58.999446 np0000003683 sudo[137495]: pam_unix(sudo:session): session closed for user root Jun 26 02:48:59.003661 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj" returned: 0 in 0.362s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:48:59.004340 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0967a30f-0598-4fc6-b866-0b8f4010402d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799019', 'path': '/dev/sdj'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:48:59.004601 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:48:59.005195 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:48:59.008912 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0967a30f-0598-4fc6-b866-0b8f4010402d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:48:59.020716 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:48:59.045056 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash) Jun 26 02:48:59.045056 np0000003683 cinder-backup[101221]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash) Jun 26 02:48:59.045056 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:59.045056 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:59.045056 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:59.045056 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:59.045056 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:59.045056 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:59.045056 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:59.045056 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:59.045056 np0000003683 cinder-backup[101221]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash) Jun 26 02:48:59.045056 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:48:59.045450 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash) Jun 26 02:48:59.045450 np0000003683 cinder-backup[101221]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash) Jun 26 02:48:59.045450 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:59.045450 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:48:59.045450 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:59.045450 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:48:59.045450 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:59.045450 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:48:59.045450 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:59.045450 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:48:59.045450 np0000003683 cinder-backup[101221]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d (non-flash) Jun 26 02:48:59.045450 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:48:59.045450 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d', '99')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:48:59.045746 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d', '99')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:48:59.047019 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Resulting device map defaultdict(. at 0x79db79267920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d'): ({'sdj'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:48:59.047538 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Removing single pathed devices sdj {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:48:59.059400 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Flushing IO for device /dev/sdj {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:48:59.068739 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:48:59.113663 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Checking to see if SCSI volumes sdj have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:48:59.113663 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] SCSI volumes sdj have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:48:59.115920 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Checking to see if device paths {'sdj'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:48:59.127462 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Device paths {'sdj'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:48:59.127781 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:48:59.139660 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:59.182542 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 99, target: iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d, portal: 192.168.40.100,3260] Jun 26 02:48:59.182542 np0000003683 cinder-backup[101221]: Logout of [sid: 99, target: iqn.2023-03.storpool.com:os--volume-0967a30f-0598-4fc6-b866-0b8f4010402d, portal: 192.168.40.100,3260] successful. Jun 26 02:48:59.182542 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:59.200018 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:48:59.200527 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.195s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:48:59.200527 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] <== disconnect_volume: return (195ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:49:00.215023 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.manager [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Encryption key ID for volume 0967a30f-0598-4fc6-b866-0b8f4010402d already matches encryption key ID in backup cff84868-8f5b-4bdb-8963-fd7d625a3b8e. {{(pid=101221) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jun 26 02:49:00.243700 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-d41f4e23-c516-495a-b05e-d5e037a0f6fa tempest-VolumesBackupsTest-232973889 None] Finished restoring backup cff84868-8f5b-4bdb-8963-fd7d625a3b8e to volume 0967a30f-0598-4fc6-b866-0b8f4010402d. Jun 26 02:49:00.402315 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] Delete backup started, backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e. Jun 26 02:49:00.408547 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_7a0a7fdd73fc40328c4c73ef53edc697 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:49:00.410076 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:49:00.412569 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] delete started, backup: cff84868-8f5b-4bdb-8963-fd7d625a3b8e, container: volumebackups, prefix: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:49:00.461849 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] generated object list: ['volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00001', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00002', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00003', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00004', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00005', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00006', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00007', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00008', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00009', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00010', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00011', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00012', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00013', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00014', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00015', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00016', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00017', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00018', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00019', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00020', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00021', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e_metadata', 'volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:49:00.490508 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00001 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.512100 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00002 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.530367 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00003 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.552557 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00004 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.571159 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00005 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.591438 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00006 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.612827 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00007 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.633199 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00008 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.652251 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00009 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.670867 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00010 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.690554 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00011 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.711654 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00012 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.730587 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00013 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.754201 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00014 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.779203 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00015 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.800772 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00016 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.824874 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00017 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.846006 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00018 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.866497 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00019 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.884915 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00020 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.914305 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e-00021 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.937672 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e_metadata in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.959557 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_0967a30f-0598-4fc6-b866-0b8f4010402d/20260626024831/az_nova_backup_cff84868-8f5b-4bdb-8963-fd7d625a3b8e_sha256file in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:00.959872 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] delete cff84868-8f5b-4bdb-8963-fd7d625a3b8e finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:49:01.004861 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:49:01.021146 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] Created reservations ['6cc1e6c1-9f8e-421e-94a9-1732992800f9', '615193ef-1493-4904-a619-228c6bf61eb2'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:49:01.040217 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-425a2be7-919e-44e9-a393-bbfe269762b4 tempest-VolumesBackupsTest-232973889 None] Delete backup finished, backup cff84868-8f5b-4bdb-8963-fd7d625a3b8e deleted. Jun 26 02:49:02.815461 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Create backup started, backup: b45b79cc-2488-40e8-ad18-f5657b996366 volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. Jun 26 02:49:02.823641 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-06-26T02:49:02Z,data_timestamp=2026-06-26T02:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-634856495',encryption_key_id=None,fail_reason=None,host='np0000003683',id=b45b79cc-2488-40e8-ad18-f5657b996366,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='7a0a7fdd73fc40328c4c73ef53edc697',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='6abcc90720de4d3e8d49aa5c4bb02b11',volume_id=a914e9e0-216f-4e20-ab41-a5bab0cfe6e4) Jun 26 02:49:02.848675 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_7a0a7fdd73fc40328c4c73ef53edc697 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:49:02.848875 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:49:02.849202 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:49:02.860050 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:49:02.881722 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:49:02.896506 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:49:02.896874 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:49:02.904829 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:49:02.906548 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe07:6d30', 'fe80::4894:fff:fe8b:ae5b', 'fe80::fc16:3eff:fe18:269', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe41:f96f', 'fe80::2ce3:a1ff:fe2c:c865'] Jun 26 02:49:02.907029 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:49:02.907212 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:49:02.907550 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] <== get_connector_properties: return (57ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:49:03.413132 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:49:03.413673 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:49:03.413914 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:49:05.681955 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.268s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:49:05.682382 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:49:05.695068 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:49:05.695587 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:49:05.695829 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:49:05.706307 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:49:05.706307 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:05.718439 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4] added Jun 26 02:49:05.718439 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:49:05.718439 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:49:05.718439 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:49:05.718439 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:49:05.718439 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:49:05.718439 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:05.718749 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:49:05.719016 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0231(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:49:05.719240 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:49:06.721016 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:49:06.734511 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:06.747247 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:06.764234 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash) Jun 26 02:49:06.764234 np0000003683 cinder-backup[101221]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash) Jun 26 02:49:06.764234 np0000003683 cinder-backup[101221]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:06.764234 np0000003683 cinder-backup[101221]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:06.764234 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:06.764234 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:06.764234 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:06.764234 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:06.764234 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:06.764234 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:06.764234 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:06.764234 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:06.764234 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:06.764605 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash) Jun 26 02:49:06.764605 np0000003683 cinder-backup[101221]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash) Jun 26 02:49:06.764605 np0000003683 cinder-backup[101221]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:06.764605 np0000003683 cinder-backup[101221]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:06.764605 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:06.764605 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:06.764605 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:06.764605 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:06.764605 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:06.764605 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:06.764605 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:06.764605 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:06.764605 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:49:06.813411 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, portal: 192.168.40.100,3260] Jun 26 02:49:06.813411 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, portal: 192.168.40.100,3260] successful. Jun 26 02:49:06.813411 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:06.824828 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:06.842503 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash) Jun 26 02:49:06.842503 np0000003683 cinder-backup[101221]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash) Jun 26 02:49:06.842503 np0000003683 cinder-backup[101221]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:06.842503 np0000003683 cinder-backup[101221]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:06.842503 np0000003683 cinder-backup[101221]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash) Jun 26 02:49:06.842503 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:06.842503 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:06.842503 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:06.842503 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:06.842503 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:06.842503 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:06.842503 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:06.842503 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:06.842503 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:06.843882 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash) Jun 26 02:49:06.843882 np0000003683 cinder-backup[101221]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf510188-22e5-49c2-b59d-6f15cd6bf204 (non-flash) Jun 26 02:49:06.843882 np0000003683 cinder-backup[101221]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:06.843882 np0000003683 cinder-backup[101221]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:06.843882 np0000003683 cinder-backup[101221]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash) Jun 26 02:49:06.843882 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:06.843882 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:06.843882 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:06.843882 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:06.843882 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:06.843882 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:06.843882 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:06.843882 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:06.843882 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:49:06.844377 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:49:06.844558 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:49:06.845760 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] HCTL ('19', '-', '-', 0) found on session 104 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:49:06.845913 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Scanning host 19 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:49:06.862724 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Searching for a device in session 104 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:49:06.862724 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:49:07.866127 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.184s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:49:07.866931 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] <== connect_volume: return (4452ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799030', 'path': '/dev/sdn'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:49:07.866990 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdn {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:49:07.888604 np0000003683 sudo[137934]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdn Jun 26 02:49:07.889260 np0000003683 sudo[137934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:49:08.202869 np0000003683 sudo[137934]: pam_unix(sudo:session): session closed for user root Jun 26 02:49:08.204847 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdn" returned: 0 in 0.338s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:49:08.260306 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:49:08.266266 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] _create_container started, container: volumebackups,backup: b45b79cc-2488-40e8-ad18-f5657b996366. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:49:08.296149 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] generate_object_name_prefix: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366 {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:49:08.301404 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] starting backup of volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, volume size: 1073741824, object names prefix volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:49:08.504070 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:08.754268 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:08.754489 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:08.864023 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:08.864287 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:09.072654 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:09.328470 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:09.328663 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:09.434084 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:09.434303 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:09.679234 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:09.938379 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:09.938578 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:10.048036 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:10.048036 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:10.272471 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:10.533496 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:10.533496 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:10.651649 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:10.651649 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:10.872606 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:11.156090 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:11.156300 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:11.265192 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:11.265466 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:11.526910 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:11.786705 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:11.786936 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:11.905139 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:11.905305 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:12.104652 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:12.362781 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:12.362988 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:12.467632 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:12.467837 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:12.657934 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:12.690802 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:49:12.691104 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:49:12.920287 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:12.920508 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:13.028158 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:13.028413 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:13.250073 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:13.496139 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:13.496420 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:13.608334 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:13.609482 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:13.808740 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:14.056168 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:14.056168 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:14.164511 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:14.164511 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:14.384510 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:14.630949 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:14.630949 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:14.753825 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:14.753825 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:14.943514 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:15.210531 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:15.210531 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:15.331976 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:15.332184 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:15.556061 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:15.815395 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:15.815573 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:15.937762 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:15.937988 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:16.124327 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:16.364813 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:16.365006 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:16.474949 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:16.475216 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:16.671454 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:16.917036 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:16.917154 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:17.028588 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:17.028793 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:17.214923 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:17.479449 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:17.479616 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:17.589957 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:17.590140 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:17.765911 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:18.038387 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:18.038585 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:18.169091 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:18.169224 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:18.369969 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:18.641313 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:18.641896 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:18.750825 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:18.750932 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:18.956205 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:19.214235 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:19.214235 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:19.319993 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:19.319993 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:19.514168 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:19.774869 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:19.774996 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:19.886816 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:19.887071 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:19.995716 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:20.124858 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:20.125021 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:20.198423 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:20.198624 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:20.205089 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:49:20.211863 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:49:20.212117 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:49:20.216890 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:49:20.217130 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:49:20.220775 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:49:20.221074 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:49:20.281997 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:49:20.282720 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] _write_metadata started, container name: volumebackups, metadata filename: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:49:20.309919 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "b45b79cc-2488-40e8-ad18-f5657b996366",\n "backup_name": "tempest-VolumesBackupsTest-Backup-634856495",\n "created_at": "2026-06-26 02:49:03+00:00",\n "objects": [\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "a914e9e0-216f-4e20-ab41-a5bab0cfe6e4",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"a914e9e0-216f-4e20-ab41-a5bab0cfe6e4\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"6abcc90720de4d3e8d49aa5c4bb02b11\\", \\"project_id\\": \\"7a0a7fdd73fc40328c4c73ef53edc697\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:49:02.000000\\", \\"launched_at\\": \\"2026-06-26T02:49:02.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-635988695\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:49:02.000000\\", \\"updated_at\\": \\"2026-06-26T02:49:03.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:49:20.321353 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] backup b45b79cc-2488-40e8-ad18-f5657b996366 finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:49:20.436448 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdn {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:49:20.456309 np0000003683 sudo[138112]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdn Jun 26 02:49:20.457165 np0000003683 sudo[138112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:49:20.801317 np0000003683 sudo[138112]: pam_unix(sudo:session): session closed for user root Jun 26 02:49:20.803603 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdn" returned: 0 in 0.367s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:49:20.804314 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799030', 'path': '/dev/sdn'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:49:20.804595 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:49:20.805168 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:49:20.805680 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:49:20.818394 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:20.819432 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:49:20.819432 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:49:20.819432 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:49:20.819432 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:49:20.850077 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:20.850077 np0000003683 cinder-backup[101221]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:20.850077 np0000003683 cinder-backup[101221]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash) Jun 26 02:49:20.850077 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:20.850077 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:20.850077 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:20.850077 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:20.850077 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:20.850077 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:20.850077 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:20.850077 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:20.850077 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:20.850560 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:20.850560 np0000003683 cinder-backup[101221]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:20.850560 np0000003683 cinder-backup[101221]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash) Jun 26 02:49:20.850560 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:20.850560 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:20.850560 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:20.850560 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:20.850560 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:20.850560 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:20.850560 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:20.850560 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:20.850560 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:49:20.850560 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', '104'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:49:20.850560 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', '104')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:49:20.851699 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Resulting device map defaultdict(. at 0x79db5a807240>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4'): ({'sdn'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:49:20.851897 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Removing single pathed devices sdn {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:49:20.862604 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Flushing IO for device /dev/sdn {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:49:20.870911 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:49:20.923773 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Checking to see if SCSI volumes sdn have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:49:20.923978 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] SCSI volumes sdn have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:49:20.925413 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Checking to see if device paths {'sdn'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:49:20.940025 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Device paths {'sdn'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:49:20.940303 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:49:20.956160 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:20.992456 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 104, target: iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, portal: 192.168.40.100,3260] Jun 26 02:49:20.992456 np0000003683 cinder-backup[101221]: Logout of [sid: 104, target: iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, portal: 192.168.40.100,3260] successful. Jun 26 02:49:20.992456 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:21.012197 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:21.012495 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.207s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:49:21.012641 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] <== disconnect_volume: return (207ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:49:22.020665 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=95,cinder:UPDATE=19,cinder:INSERT=2 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:49:22.032387 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-8f005a61-c4cb-4086-be75-b94f213222fa tempest-VolumesBackupsTest-232973889 None] Create backup finished. backup: b45b79cc-2488-40e8-ad18-f5657b996366. Jun 26 02:49:22.379797 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Create backup started, backup: 55644e11-3124-4eb4-9522-e15873f689ab volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. Jun 26 02:49:22.385053 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-06-26T02:49:22Z,data_timestamp=2026-06-26T02:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-754404148',encryption_key_id=None,fail_reason=None,host='np0000003683',id=55644e11-3124-4eb4-9522-e15873f689ab,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(b45b79cc-2488-40e8-ad18-f5657b996366),parent_id='b45b79cc-2488-40e8-ad18-f5657b996366',project_id='7a0a7fdd73fc40328c4c73ef53edc697',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='6abcc90720de4d3e8d49aa5c4bb02b11',volume_id=a914e9e0-216f-4e20-ab41-a5bab0cfe6e4) Jun 26 02:49:22.409813 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_7a0a7fdd73fc40328c4c73ef53edc697 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:49:22.409978 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:49:22.410188 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:49:22.420330 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:49:22.438093 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:49:22.452312 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:49:22.452619 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:49:22.460237 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:49:22.461710 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe07:6d30', 'fe80::4894:fff:fe8b:ae5b', 'fe80::fc16:3eff:fe18:269', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe41:f96f', 'fe80::2ce3:a1ff:fe2c:c865'] Jun 26 02:49:22.461863 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:49:22.461981 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:49:22.462208 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] <== get_connector_properties: return (51ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:49:22.965713 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:49:22.966059 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:49:22.966213 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:49:22.966684 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:49:22.966870 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:49:22.977598 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:49:22.977964 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:49:22.978191 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:49:22.988088 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:49:22.988088 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:22.997210 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4] added Jun 26 02:49:22.997210 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:49:22.997210 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:49:22.997210 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:49:22.997210 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:49:22.997210 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:49:22.997210 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:22.997586 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:49:22.997841 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0195(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:49:22.998028 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:49:23.999061 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:49:24.010380 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:24.021036 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:24.036342 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:24.036342 np0000003683 cinder-backup[101221]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:24.036342 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:24.036342 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:24.036342 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:24.036342 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:24.036342 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:24.036342 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:24.036342 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:24.036342 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:24.036342 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:24.036657 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:24.036657 np0000003683 cinder-backup[101221]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:24.036657 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:24.036657 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:24.036657 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:24.036657 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:24.036657 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:24.036657 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:24.036657 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:24.036657 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:24.036657 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:49:24.084619 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, portal: 192.168.40.100,3260] Jun 26 02:49:24.084619 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, portal: 192.168.40.100,3260] successful. Jun 26 02:49:24.084619 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:24.096200 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:24.124840 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:24.124840 np0000003683 cinder-backup[101221]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:24.124840 np0000003683 cinder-backup[101221]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash) Jun 26 02:49:24.124840 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:24.124840 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:24.124840 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:24.124840 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:24.124840 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:24.124840 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:24.124840 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:24.124840 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:24.124840 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:24.125085 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:24.125085 np0000003683 cinder-backup[101221]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4908758e-df4e-41d6-9f1e-6858767334db (non-flash) Jun 26 02:49:24.125085 np0000003683 cinder-backup[101221]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash) Jun 26 02:49:24.125085 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:24.125085 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:24.125085 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:24.125085 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:24.125085 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:24.125085 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:24.125085 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:24.125085 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:24.125085 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:49:24.125338 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:49:24.125448 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:49:24.126506 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] HCTL ('16', '-', '-', 0) found on session 105 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:49:24.126648 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Scanning host 16 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:49:24.139376 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Searching for a device in session 105 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:49:24.139376 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:49:25.142348 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.175s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:49:25.142868 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] <== connect_volume: return (2175ms) {'type': 'block', 'scsi_wwn': '330000000c0ca6310', 'path': '/dev/sdk'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:49:25.142922 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:49:25.161803 np0000003683 sudo[138251]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk Jun 26 02:49:25.162514 np0000003683 sudo[138251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:49:25.482553 np0000003683 sudo[138251]: pam_unix(sudo:session): session closed for user root Jun 26 02:49:25.484636 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk" returned: 0 in 0.341s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:49:25.522117 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:49:25.533189 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366_sha256file. {{(pid=101221) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jun 26 02:49:25.563657 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] _read_sha256file finished. {{(pid=101221) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jun 26 02:49:25.571447 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] _create_container started, container: volumebackups,backup: 55644e11-3124-4eb4-9522-e15873f689ab. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:49:25.597403 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] generate_object_name_prefix: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024925/az_nova_backup_55644e11-3124-4eb4-9522-e15873f689ab {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:49:25.602140 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] starting backup of volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, volume size: 1073741824, object names prefix volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024925/az_nova_backup_55644e11-3124-4eb4-9522-e15873f689ab, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:49:29.785276 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:49:29.789993 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:49:29.790152 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:49:29.794052 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:49:29.794226 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:49:29.797196 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:49:29.797425 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024925/az_nova_backup_55644e11-3124-4eb4-9522-e15873f689ab_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:49:29.857340 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:49:29.857340 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] _write_metadata started, container name: volumebackups, metadata filename: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024925/az_nova_backup_55644e11-3124-4eb4-9522-e15873f689ab_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:49:29.881218 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "55644e11-3124-4eb4-9522-e15873f689ab",\n "backup_name": "tempest-VolumesBackupsTest-Backup-754404148",\n "created_at": "2026-06-26 02:49:22+00:00",\n "objects": [],\n "parent_id": "b45b79cc-2488-40e8-ad18-f5657b996366",\n "version": "1.0.0",\n "volume_id": "a914e9e0-216f-4e20-ab41-a5bab0cfe6e4",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"a914e9e0-216f-4e20-ab41-a5bab0cfe6e4\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"6abcc90720de4d3e8d49aa5c4bb02b11\\", \\"project_id\\": \\"7a0a7fdd73fc40328c4c73ef53edc697\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:49:02.000000\\", \\"launched_at\\": \\"2026-06-26T02:49:02.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-635988695\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:49:02.000000\\", \\"updated_at\\": \\"2026-06-26T02:49:22.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:49:29.886440 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] backup 55644e11-3124-4eb4-9522-e15873f689ab finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:49:30.017916 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:49:30.034980 np0000003683 sudo[138632]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk Jun 26 02:49:30.035639 np0000003683 sudo[138632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:49:30.451600 np0000003683 sudo[138632]: pam_unix(sudo:session): session closed for user root Jun 26 02:49:30.453900 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk" returned: 0 in 0.436s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:49:30.454579 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000c0ca6310', 'path': '/dev/sdk'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:49:30.454787 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:49:31.712591 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.258s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:49:31.712972 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:49:31.727701 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:31.728859 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:49:31.728859 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:49:31.728859 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:49:31.728859 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:31.760013 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:49:31.761152 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86546ce9-7ea0-4194-a7e8-e2ad73495e33', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:49:31.761152 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', '105')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:49:31.762694 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Resulting device map defaultdict(. at 0x79db5a805940>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4'): ({'sdk'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:49:31.762694 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Removing single pathed devices sdk {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:49:31.779631 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Flushing IO for device /dev/sdk {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:49:31.786676 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:49:31.824987 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Checking to see if SCSI volumes sdk have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:49:31.825243 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] SCSI volumes sdk have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:49:31.827728 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Checking to see if device paths {'sdk'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:49:31.840141 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Device paths {'sdk'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:49:31.840141 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:49:31.854896 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:31.901568 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 105, target: iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, portal: 192.168.40.100,3260] Jun 26 02:49:31.901568 np0000003683 cinder-backup[101221]: Logout of [sid: 105, target: iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, portal: 192.168.40.100,3260] successful. Jun 26 02:49:31.901568 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:31.930972 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:31.932341 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.219s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:49:31.932341 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] <== disconnect_volume: return (1476ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:49:32.991486 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-5862e83e-3b6c-45e5-bb0f-d7a34a19a7a9 tempest-VolumesBackupsTest-232973889 None] Create backup finished. backup: 55644e11-3124-4eb4-9522-e15873f689ab. Jun 26 02:49:33.675366 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Restore backup started, backup: 55644e11-3124-4eb4-9522-e15873f689ab volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. Jun 26 02:49:33.687131 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_7a0a7fdd73fc40328c4c73ef53edc697 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:49:33.687397 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:49:33.687782 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:49:33.697730 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:49:33.719172 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:49:33.731609 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:49:33.731984 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:49:33.739314 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:49:33.740705 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe18:269', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe41:f96f', 'fe80::2ce3:a1ff:fe2c:c865', 'fe80::fc16:3eff:fe06:4738'] Jun 26 02:49:33.740817 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:49:33.740925 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:49:33.741155 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] <== get_connector_properties: return (53ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:49:34.748073 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:49:34.748459 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:49:34.748636 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:49:34.749084 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:49:34.749318 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:49:34.759439 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:49:34.759755 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:49:34.759940 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:49:34.770697 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:49:34.770697 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:34.781986 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4] added Jun 26 02:49:34.781986 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:49:34.781986 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:49:34.781986 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:49:34.781986 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:49:34.781986 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:49:34.781986 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:34.782343 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:49:34.783043 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.023(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:49:34.783594 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:49:35.784582 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:49:35.796123 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:35.807302 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:35.826626 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:35.826626 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:35.826626 np0000003683 cinder-backup[101221]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:35.826626 np0000003683 cinder-backup[101221]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:35.826626 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:35.826626 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:35.826626 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:35.826626 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:35.826626 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:35.826626 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:35.826626 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:35.826991 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:35.826991 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:35.826991 np0000003683 cinder-backup[101221]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:35.826991 np0000003683 cinder-backup[101221]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:35.826991 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:35.826991 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:35.826991 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:35.826991 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:35.826991 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:35.826991 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:35.826991 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:49:35.874871 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, portal: 192.168.40.100,3260] Jun 26 02:49:35.874871 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, portal: 192.168.40.100,3260] successful. Jun 26 02:49:35.874871 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:35.885020 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:35.904818 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:35.904818 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:35.904818 np0000003683 cinder-backup[101221]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:35.904818 np0000003683 cinder-backup[101221]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:35.904818 np0000003683 cinder-backup[101221]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash) Jun 26 02:49:35.904818 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:35.904818 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:35.904818 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:35.904818 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:35.904818 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:35.904818 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:35.904818 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:35.905318 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:35.905318 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:35.905318 np0000003683 cinder-backup[101221]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:35.905318 np0000003683 cinder-backup[101221]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:35.905318 np0000003683 cinder-backup[101221]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash) Jun 26 02:49:35.905318 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:35.905318 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:35.905318 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:35.905318 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:35.905318 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:35.905318 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:35.905318 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:49:35.905823 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:49:35.906054 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:49:35.907470 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] HCTL ('7', '-', '-', 0) found on session 110 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:49:35.907730 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:49:35.925651 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Searching for a device in session 110 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:49:35.925912 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:49:36.931667 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.182s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:49:36.932057 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] <== connect_volume: return (2183ms) {'type': 'block', 'scsi_wwn': '330000000c0ca6310', 'path': '/dev/sdb'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:49:36.932188 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:49:36.954140 np0000003683 sudo[138912]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jun 26 02:49:36.954980 np0000003683 sudo[138912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:49:37.355525 np0000003683 sudo[138912]: pam_unix(sudo:session): session closed for user root Jun 26 02:49:37.357783 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.425s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:49:37.358164 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] starting restore of backup volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024925/az_nova_backup_55644e11-3124-4eb4-9522-e15873f689ab container: volumebackups, to existing volume a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, backup: 55644e11-3124-4eb4-9522-e15873f689ab. {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jun 26 02:49:37.358337 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] _read_metadata started, container name: volumebackups, metadata filename: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024925/az_nova_backup_55644e11-3124-4eb4-9522-e15873f689ab_metadata. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jun 26 02:49:37.402785 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] _read_metadata finished. Metadata: { Jun 26 02:49:37.402785 np0000003683 cinder-backup[101221]: "backup_description": null, Jun 26 02:49:37.402785 np0000003683 cinder-backup[101221]: "backup_id": "55644e11-3124-4eb4-9522-e15873f689ab", Jun 26 02:49:37.402785 np0000003683 cinder-backup[101221]: "backup_name": "tempest-VolumesBackupsTest-Backup-754404148", Jun 26 02:49:37.402785 np0000003683 cinder-backup[101221]: "created_at": "2026-06-26 02:49:22+00:00", Jun 26 02:49:37.402785 np0000003683 cinder-backup[101221]: "objects": [], Jun 26 02:49:37.402785 np0000003683 cinder-backup[101221]: "parent_id": "b45b79cc-2488-40e8-ad18-f5657b996366", Jun 26 02:49:37.402785 np0000003683 cinder-backup[101221]: "version": "1.0.0", Jun 26 02:49:37.402785 np0000003683 cinder-backup[101221]: "volume_id": "a914e9e0-216f-4e20-ab41-a5bab0cfe6e4", Jun 26 02:49:37.402785 np0000003683 cinder-backup[101221]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"a914e9e0-216f-4e20-ab41-a5bab0cfe6e4\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"6abcc90720de4d3e8d49aa5c4bb02b11\", \"project_id\": \"7a0a7fdd73fc40328c4c73ef53edc697\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000003683@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-06-26T02:49:02.000000\", \"launched_at\": \"2026-06-26T02:49:02.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-635988695\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"268cd356-e153-49dd-857f-2ea5794ac5be\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"26cf225a-ef51-42c6-990c-f9523cca3d45\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-06-26T02:49:02.000000\", \"updated_at\": \"2026-06-26T02:49:22.000000\"}}" Jun 26 02:49:37.402785 np0000003683 cinder-backup[101221]: }. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jun 26 02:49:37.403225 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Restoring backup version 1.0.0 {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jun 26 02:49:37.452527 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:49:37.458241 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] _read_metadata started, container name: volumebackups, metadata filename: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366_metadata. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] _read_metadata finished. Metadata: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "backup_description": null, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "backup_id": "b45b79cc-2488-40e8-ad18-f5657b996366", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "backup_name": "tempest-VolumesBackupsTest-Backup-634856495", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "created_at": "2026-06-26 02:49:03+00:00", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "objects": [ Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00001": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 0 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00002": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 52428800 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00003": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 104857600 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00004": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 157286400 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00005": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 209715200 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00006": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 262144000 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00007": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 314572800 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00008": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 367001600 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00009": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 419430400 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00010": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 471859200 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00011": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 524288000 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00012": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 576716800 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00013": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 629145600 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00014": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 681574400 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00015": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 734003200 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00016": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 786432000 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00017": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 838860800 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00018": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 891289600 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00019": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 943718400 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00020": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 996147200 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00021": { Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "length": 25165824, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "offset": 1048576000 Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: } Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: ], Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "parent_id": null, Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "version": "1.0.0", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_id": "a914e9e0-216f-4e20-ab41-a5bab0cfe6e4", Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"a914e9e0-216f-4e20-ab41-a5bab0cfe6e4\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"6abcc90720de4d3e8d49aa5c4bb02b11\", \"project_id\": \"7a0a7fdd73fc40328c4c73ef53edc697\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000003683@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-06-26T02:49:02.000000\", \"launched_at\": \"2026-06-26T02:49:02.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-635988695\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"268cd356-e153-49dd-857f-2ea5794ac5be\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"26cf225a-ef51-42c6-990c-f9523cca3d45\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-06-26T02:49:02.000000\", \"updated_at\": \"2026-06-26T02:49:03.000000\"}}" Jun 26 02:49:37.485952 np0000003683 cinder-backup[101221]: }. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jun 26 02:49:37.490452 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] v1 volume backup restore of b45b79cc-2488-40e8-ad18-f5657b996366 started. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jun 26 02:49:37.490452 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] metadata_object_names = ['volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00001', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00002', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00003', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00004', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00005', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00006', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00007', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00008', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00009', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00010', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00011', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00012', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00013', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00014', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00015', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00016', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00017', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00018', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00019', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00020', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00021']. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jun 26 02:49:37.531231 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] generated object list: ['volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00001', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00002', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00003', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00004', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00005', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00006', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00007', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00008', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00009', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00010', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00011', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00012', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00013', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00014', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00015', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00016', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00017', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00018', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00019', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00020', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00021', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366_metadata', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:49:37.538212 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00001, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:37.570143 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:38.016126 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00002, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:38.032538 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:38.450996 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00003, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:38.471785 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:38.872603 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00004, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:38.887499 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:39.285259 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00005, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:39.302722 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:39.402752 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Create backup started, backup: ea0b2670-f73d-4d09-a2ed-e5b09a67ef16 volume: 6a4b4d30-68ae-4952-8c21-d5360ffcd7bc. Jun 26 02:49:39.408801 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupsv39test-backup-container-1152892557',created_at=2026-06-26T02:49:39Z,data_timestamp=2026-06-26T02:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-287824265',encryption_key_id=None,fail_reason=None,host='np0000003683',id=ea0b2670-f73d-4d09-a2ed-e5b09a67ef16,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='5b9fe6eb6628444689f26c19cf7c3c7f',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='26eab4a53e0d4a9fa6e211fe27f9eb3c',volume_id=6a4b4d30-68ae-4952-8c21-d5360ffcd7bc) Jun 26 02:49:39.455105 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_5b9fe6eb6628444689f26c19cf7c3c7f {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:49:39.455275 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:49:39.455695 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:49:39.474741 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:49:39.527949 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:49:39.547033 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:49:39.547033 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:49:39.558094 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:49:39.558094 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe41:f96f', 'fe80::2ce3:a1ff:fe2c:c865', 'fe80::fc16:3eff:fe06:4738'] Jun 26 02:49:39.558094 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:49:39.558094 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:49:39.558298 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:49:39.789694 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:49:39.793648 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00006, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:39.815159 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:40.065630 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:49:40.066081 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a4b4d30-68ae-4952-8c21-d5360ffcd7bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:49:40.066401 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:49:40.066892 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:49:40.067127 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a4b4d30-68ae-4952-8c21-d5360ffcd7bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:49:40.212196 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:49:40.212537 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:49:40.212759 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:49:40.216368 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00007, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:40.223326 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:49:40.223326 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:40.231000 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:40.235267 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc] added Jun 26 02:49:40.235267 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:49:40.235267 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:49:40.235267 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:49:40.235267 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:49:40.235267 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:49:40.235267 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:40.235533 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:49:40.235809 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.023(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:49:40.236000 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:49:40.610948 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00008, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:40.624830 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:41.058972 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00009, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:41.071071 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:41.236695 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:49:41.247531 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:41.286721 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:41.303091 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:41.303091 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:41.303091 np0000003683 cinder-backup[101221]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:41.303091 np0000003683 cinder-backup[101221]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:41.303091 np0000003683 cinder-backup[101221]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash) Jun 26 02:49:41.303091 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:41.303091 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:41.303091 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:41.303091 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:41.303091 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:41.303091 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:41.303091 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:41.303358 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:41.303358 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:41.303358 np0000003683 cinder-backup[101221]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:41.303358 np0000003683 cinder-backup[101221]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:41.303358 np0000003683 cinder-backup[101221]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash) Jun 26 02:49:41.303358 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:41.303358 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:41.303358 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:41.303358 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:41.303358 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:41.303358 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:41.303358 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:49:41.469879 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc, portal: 192.168.40.100,3260] Jun 26 02:49:41.469879 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc, portal: 192.168.40.100,3260] successful. Jun 26 02:49:41.469879 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:41.476871 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00010, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:41.487615 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:41.493143 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:41.514311 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:41.514311 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:41.514311 np0000003683 cinder-backup[101221]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:41.514311 np0000003683 cinder-backup[101221]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:41.514311 np0000003683 cinder-backup[101221]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash) Jun 26 02:49:41.514311 np0000003683 cinder-backup[101221]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash) Jun 26 02:49:41.514311 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:41.514311 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:41.514311 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:41.514311 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:41.514311 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:41.514311 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:41.514311 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:41.514563 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:41.514563 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:41.514563 np0000003683 cinder-backup[101221]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:41.514563 np0000003683 cinder-backup[101221]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:41.514563 np0000003683 cinder-backup[101221]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash) Jun 26 02:49:41.514563 np0000003683 cinder-backup[101221]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash) Jun 26 02:49:41.514563 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:41.514563 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:41.514563 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:41.514563 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:41.514563 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:41.514563 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:41.514563 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:49:41.514865 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.302s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:49:41.514915 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:49:41.515996 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] HCTL ('8', '-', '-', 0) found on session 111 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:49:41.516129 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Scanning host 8 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:49:41.528585 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Searching for a device in session 111 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:49:41.528785 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a4b4d30-68ae-4952-8c21-d5360ffcd7bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:49:41.889489 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00011, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:41.903737 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:42.294563 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00012, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:42.321687 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:42.533977 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.467s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:49:42.534196 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] <== connect_volume: return (2467ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799053', 'path': '/dev/sdc'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:49:42.534602 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:49:42.560000 np0000003683 sudo[139088]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc Jun 26 02:49:42.560921 np0000003683 sudo[139088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:49:42.723920 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00013, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:42.738722 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:42.887608 np0000003683 sudo[139088]: pam_unix(sudo:session): session closed for user root Jun 26 02:49:42.889505 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc" returned: 0 in 0.355s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:49:42.897255 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] _create_container started, container: tempest-volumesbackupsv39test-backup-container-1152892557,backup: ea0b2670-f73d-4d09-a2ed-e5b09a67ef16. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:49:43.138343 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00014, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:43.153188 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:43.180584 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] generate_object_name_prefix: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16 {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:49:43.186811 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] starting backup of volume: 6a4b4d30-68ae-4952-8c21-d5360ffcd7bc, volume size: 1073741824, object names prefix volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:49:43.573637 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:43.577096 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00015, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:43.598001 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:43.830512 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:43.830692 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:43.987306 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00016, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:44.003337 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:44.060096 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:44.060258 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:44.272876 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:44.446430 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00017, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:44.462511 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:44.552225 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:44.552440 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:44.675471 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:44.675471 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:44.963504 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00018, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:44.983359 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:45.000896 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:45.381824 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:45.382049 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:45.385505 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00019, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:45.408190 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:45.491727 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:45.491955 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:45.818599 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:45.822155 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00020, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:45.844514 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:46.068613 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:46.069082 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:46.281529 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restoring object. backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, object name: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00021, volume: a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:49:46.306735 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:49:46.366721 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:46.366864 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:46.560028 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] v1 volume backup restore of b45b79cc-2488-40e8-ad18-f5657b996366 finished. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jun 26 02:49:46.560331 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Restoring volume base metadata {{(pid=101221) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jun 26 02:49:46.565337 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Excluding field 'display_name' {{(pid=101221) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jun 26 02:49:46.565468 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Excluding field 'display_description' {{(pid=101221) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jun 26 02:49:46.576300 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] No metadata of type 'volume-metadata' to restore {{(pid=101221) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jun 26 02:49:46.576430 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101221) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jun 26 02:49:46.576595 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] _read_metadata started, container name: volumebackups, metadata filename: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024925/az_nova_backup_55644e11-3124-4eb4-9522-e15873f689ab_metadata. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jun 26 02:49:46.592903 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] _read_metadata finished. Metadata: { Jun 26 02:49:46.592903 np0000003683 cinder-backup[101221]: "backup_description": null, Jun 26 02:49:46.592903 np0000003683 cinder-backup[101221]: "backup_id": "55644e11-3124-4eb4-9522-e15873f689ab", Jun 26 02:49:46.592903 np0000003683 cinder-backup[101221]: "backup_name": "tempest-VolumesBackupsTest-Backup-754404148", Jun 26 02:49:46.592903 np0000003683 cinder-backup[101221]: "created_at": "2026-06-26 02:49:22+00:00", Jun 26 02:49:46.592903 np0000003683 cinder-backup[101221]: "objects": [], Jun 26 02:49:46.592903 np0000003683 cinder-backup[101221]: "parent_id": "b45b79cc-2488-40e8-ad18-f5657b996366", Jun 26 02:49:46.592903 np0000003683 cinder-backup[101221]: "version": "1.0.0", Jun 26 02:49:46.592903 np0000003683 cinder-backup[101221]: "volume_id": "a914e9e0-216f-4e20-ab41-a5bab0cfe6e4", Jun 26 02:49:46.592903 np0000003683 cinder-backup[101221]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"a914e9e0-216f-4e20-ab41-a5bab0cfe6e4\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"6abcc90720de4d3e8d49aa5c4bb02b11\", \"project_id\": \"7a0a7fdd73fc40328c4c73ef53edc697\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000003683@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-06-26T02:49:02.000000\", \"launched_at\": \"2026-06-26T02:49:02.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-635988695\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"268cd356-e153-49dd-857f-2ea5794ac5be\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"26cf225a-ef51-42c6-990c-f9523cca3d45\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-06-26T02:49:02.000000\", \"updated_at\": \"2026-06-26T02:49:22.000000\"}}" Jun 26 02:49:46.592903 np0000003683 cinder-backup[101221]: }. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jun 26 02:49:46.593225 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] v1 volume backup restore of 55644e11-3124-4eb4-9522-e15873f689ab started. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jun 26 02:49:46.593225 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] metadata_object_names = []. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jun 26 02:49:46.622317 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] generated object list: ['volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024925/az_nova_backup_55644e11-3124-4eb4-9522-e15873f689ab_metadata', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024925/az_nova_backup_55644e11-3124-4eb4-9522-e15873f689ab_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:49:46.622460 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] v1 volume backup restore of 55644e11-3124-4eb4-9522-e15873f689ab finished. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jun 26 02:49:46.622628 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Restoring volume base metadata {{(pid=101221) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jun 26 02:49:46.627049 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Excluding field 'display_name' {{(pid=101221) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jun 26 02:49:46.627206 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Excluding field 'display_description' {{(pid=101221) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jun 26 02:49:46.629728 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] No metadata of type 'volume-metadata' to restore {{(pid=101221) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jun 26 02:49:46.629818 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101221) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jun 26 02:49:46.629945 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] restore 55644e11-3124-4eb4-9522-e15873f689ab to a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 finished. {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jun 26 02:49:46.858219 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:49:46.868167 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:46.877754 np0000003683 sudo[139117]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jun 26 02:49:46.878578 np0000003683 sudo[139117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:49:47.152781 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:47.153184 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:47.239130 np0000003683 sudo[139117]: pam_unix(sudo:session): session closed for user root Jun 26 02:49:47.241392 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.383s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:49:47.243911 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000c0ca6310', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:49:47.244179 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:49:47.244781 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:49:47.245303 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:49:47.259044 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:47.260012 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:49:47.260012 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:49:47.260012 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:49:47.260012 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:49:47.277854 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:47.278013 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:47.291126 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:47.291126 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:47.291126 np0000003683 cinder-backup[101221]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:47.291126 np0000003683 cinder-backup[101221]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:47.291126 np0000003683 cinder-backup[101221]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash) Jun 26 02:49:47.291126 np0000003683 cinder-backup[101221]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash) Jun 26 02:49:47.291126 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:47.291126 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:47.291126 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:47.291126 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:47.291126 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:47.291126 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:47.291126 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:47.291720 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:47.291720 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:47.291720 np0000003683 cinder-backup[101221]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:47.291720 np0000003683 cinder-backup[101221]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:47.291720 np0000003683 cinder-backup[101221]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 (non-flash) Jun 26 02:49:47.291720 np0000003683 cinder-backup[101221]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash) Jun 26 02:49:47.291720 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:47.291720 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:47.291720 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:47.291720 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:47.291720 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:47.291720 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:47.291720 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:49:47.291956 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', '110'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:49:47.291956 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4', '110')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:49:47.295346 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Resulting device map defaultdict(. at 0x79db791c1260>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4'): ({'sdb'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:49:47.295699 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Removing single pathed devices sdb {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:49:47.307963 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Flushing IO for device /dev/sdb {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:49:47.317429 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:49:47.376273 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:49:47.376459 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] SCSI volumes sdb have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:49:47.378144 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:49:47.390569 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:49:47.390839 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:49:47.408451 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:47.456226 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 110, target: iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, portal: 192.168.40.100,3260] Jun 26 02:49:47.456226 np0000003683 cinder-backup[101221]: Logout of [sid: 110, target: iqn.2023-03.storpool.com:os--volume-a914e9e0-216f-4e20-ab41-a5bab0cfe6e4, portal: 192.168.40.100,3260] successful. Jun 26 02:49:47.456226 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:47.480867 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:47.481298 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.236s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:49:47.481535 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] <== disconnect_volume: return (237ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:49:47.488196 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:47.737913 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:47.738142 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:47.852325 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:47.852470 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:48.035862 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:48.296216 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:48.296216 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:48.413219 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:48.413398 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:48.496220 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.manager [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Encryption key ID for volume a914e9e0-216f-4e20-ab41-a5bab0cfe6e4 already matches encryption key ID in backup 55644e11-3124-4eb4-9522-e15873f689ab. {{(pid=101221) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jun 26 02:49:48.516758 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-3c83b9bb-c391-4612-b729-4e046866822f tempest-VolumesBackupsTest-232973889 None] Finished restoring backup 55644e11-3124-4eb4-9522-e15873f689ab to volume a914e9e0-216f-4e20-ab41-a5bab0cfe6e4. Jun 26 02:49:48.607298 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:48.888298 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:48.888489 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:48.994717 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:48.994717 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:49.134150 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-e01b596e-6b3e-4f33-83f2-668f22999051 tempest-VolumesBackupsTest-232973889 None] Delete backup started, backup: 55644e11-3124-4eb4-9522-e15873f689ab. Jun 26 02:49:49.139164 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-e01b596e-6b3e-4f33-83f2-668f22999051 tempest-VolumesBackupsTest-232973889 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_7a0a7fdd73fc40328c4c73ef53edc697 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:49:49.139519 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-e01b596e-6b3e-4f33-83f2-668f22999051 tempest-VolumesBackupsTest-232973889 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:49:49.139893 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e01b596e-6b3e-4f33-83f2-668f22999051 tempest-VolumesBackupsTest-232973889 None] delete started, backup: 55644e11-3124-4eb4-9522-e15873f689ab, container: volumebackups, prefix: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024925/az_nova_backup_55644e11-3124-4eb4-9522-e15873f689ab. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:49:49.182335 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e01b596e-6b3e-4f33-83f2-668f22999051 tempest-VolumesBackupsTest-232973889 None] generated object list: ['volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024925/az_nova_backup_55644e11-3124-4eb4-9522-e15873f689ab_metadata', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024925/az_nova_backup_55644e11-3124-4eb4-9522-e15873f689ab_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:49:49.203132 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e01b596e-6b3e-4f33-83f2-668f22999051 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024925/az_nova_backup_55644e11-3124-4eb4-9522-e15873f689ab_metadata in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:49.210094 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:49.228000 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e01b596e-6b3e-4f33-83f2-668f22999051 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024925/az_nova_backup_55644e11-3124-4eb4-9522-e15873f689ab_sha256file in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:49.228316 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e01b596e-6b3e-4f33-83f2-668f22999051 tempest-VolumesBackupsTest-232973889 None] delete 55644e11-3124-4eb4-9522-e15873f689ab finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:49:49.265699 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-e01b596e-6b3e-4f33-83f2-668f22999051 tempest-VolumesBackupsTest-232973889 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:49:49.281644 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-e01b596e-6b3e-4f33-83f2-668f22999051 tempest-VolumesBackupsTest-232973889 None] Created reservations ['90c45299-edb8-4c2a-9169-7258e2c63bba', '3d2a6ea7-e0cf-41ef-ad21-6533cc688ddd'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:49:49.313155 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-e01b596e-6b3e-4f33-83f2-668f22999051 tempest-VolumesBackupsTest-232973889 None] Delete backup finished, backup 55644e11-3124-4eb4-9522-e15873f689ab deleted. Jun 26 02:49:49.453500 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:49.453680 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:49.555865 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:49.556100 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:49.784008 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:50.037635 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:50.037884 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:50.147440 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:50.147697 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:50.212869 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] Delete backup started, backup: b45b79cc-2488-40e8-ad18-f5657b996366. Jun 26 02:49:50.218339 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_7a0a7fdd73fc40328c4c73ef53edc697 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:49:50.218575 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:49:50.218766 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] delete started, backup: b45b79cc-2488-40e8-ad18-f5657b996366, container: volumebackups, prefix: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:49:50.265146 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] generated object list: ['volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00001', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00002', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00003', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00004', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00005', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00006', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00007', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00008', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00009', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00010', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00011', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00012', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00013', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00014', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00015', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00016', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00017', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00018', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00019', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00020', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00021', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366_metadata', 'volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:49:50.285426 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00001 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.311779 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00002 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.331129 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00003 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.350362 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:50.354973 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00004 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.377613 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00005 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.396303 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00006 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.434654 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00007 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.443364 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:49:50.450661 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Create backup started, backup: 6c5d1cb3-89cc-4e89-b511-239c7326c849 volume: 8841aced-68ba-467f-bbc7-c77bc02c0152. Jun 26 02:49:50.455652 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00008 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.458563 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-06-26T02:49:50Z,data_timestamp=2026-06-26T02:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-56543245',encryption_key_id=None,fail_reason=None,host='np0000003683',id=6c5d1cb3-89cc-4e89-b511-239c7326c849,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='56301a4e8d3e4c228f3a24467568fd7b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='76814a8561f64788a98990bb48923696',volume_id=8841aced-68ba-467f-bbc7-c77bc02c0152) Jun 26 02:49:50.475621 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00009 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.484287 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_56301a4e8d3e4c228f3a24467568fd7b {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:49:50.484438 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:49:50.484768 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:49:50.494229 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:49:50.495701 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00010 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.512312 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:49:50.524263 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00011 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.529422 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:49:50.531734 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:49:50.541583 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:49:50.542730 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe06:4738'] Jun 26 02:49:50.544066 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:49:50.544066 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:49:50.544066 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] <== get_connector_properties: return (58ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:49:50.547459 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00012 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.571157 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00013 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.596650 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00014 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.615444 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00015 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.618284 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:50.618445 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:50.634383 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00016 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.661535 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00017 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.705750 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00018 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.713737 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-a333b490-193d-427d-9c3a-368f0d8effb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:49:50.725785 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00019 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.744014 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:50.744215 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:50.751503 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00020 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.774337 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366-00021 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.805505 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366_metadata in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.834367 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a914e9e0-216f-4e20-ab41-a5bab0cfe6e4/20260626024908/az_nova_backup_b45b79cc-2488-40e8-ad18-f5657b996366_sha256file in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:49:50.835661 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] delete b45b79cc-2488-40e8-ad18-f5657b996366 finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:49:50.893925 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] Created reservations ['5b286b0f-80a0-4f8b-a011-0f593cfc5fd2', 'c722bf7c-8382-4bf6-b12b-66d037d161b9'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:49:50.931501 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-2a74b65a-c7ba-4eb4-8122-fd34fa0adadc tempest-VolumesBackupsTest-232973889 None] Delete backup finished, backup b45b79cc-2488-40e8-ad18-f5657b996366 deleted. Jun 26 02:49:50.966203 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:51.049496 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:49:51.050117 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8841aced-68ba-467f-bbc7-c77bc02c0152', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:49:51.050403 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:49:51.050953 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:49:51.051263 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8841aced-68ba-467f-bbc7-c77bc02c0152', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:49:51.063646 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:49:51.064092 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:49:51.064791 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:49:51.080533 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:49:51.080533 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:51.098917 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152] added Jun 26 02:49:51.098917 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:49:51.098917 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:49:51.098917 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:49:51.098917 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:49:51.098917 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:49:51.098917 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:51.099217 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:49:51.099541 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0351(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:49:51.099847 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:49:51.239011 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:51.239011 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:51.353188 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:51.353559 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:51.560910 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:51.824377 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:51.824377 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:51.922944 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:51.923159 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:52.104135 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:49:52.117401 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:52.130345 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:52.148890 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:52.153585 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:52.153585 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:52.153585 np0000003683 cinder-backup[101221]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:52.153585 np0000003683 cinder-backup[101221]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:52.153585 np0000003683 cinder-backup[101221]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash) Jun 26 02:49:52.153585 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:52.153585 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:52.153585 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:52.153585 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:52.153585 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:52.153585 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:52.153585 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:52.153931 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:52.153931 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:52.153931 np0000003683 cinder-backup[101221]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:52.153931 np0000003683 cinder-backup[101221]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:52.153931 np0000003683 cinder-backup[101221]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash) Jun 26 02:49:52.153931 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:52.153931 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:52.153931 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:52.153931 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:52.153931 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:52.153931 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:52.153931 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:49:52.205968 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152, portal: 192.168.40.100,3260] Jun 26 02:49:52.205968 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152, portal: 192.168.40.100,3260] successful. Jun 26 02:49:52.205968 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:52.216072 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:52.232726 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:52.232726 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:52.232726 np0000003683 cinder-backup[101221]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:52.232726 np0000003683 cinder-backup[101221]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:52.232726 np0000003683 cinder-backup[101221]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash) Jun 26 02:49:52.232726 np0000003683 cinder-backup[101221]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash) Jun 26 02:49:52.232726 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:52.232726 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:52.232726 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:52.232726 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:52.232726 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:52.232726 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:52.232726 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:52.233032 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:52.233032 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:52.233032 np0000003683 cinder-backup[101221]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:52.233032 np0000003683 cinder-backup[101221]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:49:52.233032 np0000003683 cinder-backup[101221]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash) Jun 26 02:49:52.233032 np0000003683 cinder-backup[101221]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash) Jun 26 02:49:52.233032 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:52.233032 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:52.233032 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:52.233032 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:52.233032 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:52.233032 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:52.233032 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:49:52.233266 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:49:52.233333 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:49:52.234467 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] HCTL ('7', '-', '-', 0) found on session 112 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:49:52.234628 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:49:52.249986 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Searching for a device in session 112 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:49:52.250227 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8841aced-68ba-467f-bbc7-c77bc02c0152', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:49:52.409056 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:52.409468 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:52.519084 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:52.519233 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:52.702555 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:52.763975 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Create backup started, backup: 5464cf72-b70d-4129-ba1b-1c34c4c31aae volume: a5fbcabf-ce3a-4fad-9b90-c7b9003301d0. Jun 26 02:49:52.773937 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-06-26T02:49:52Z,data_timestamp=2026-06-26T02:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-411784569',encryption_key_id=None,fail_reason=None,host='np0000003683',id=5464cf72-b70d-4129-ba1b-1c34c4c31aae,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='7a0a7fdd73fc40328c4c73ef53edc697',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='6abcc90720de4d3e8d49aa5c4bb02b11',volume_id=a5fbcabf-ce3a-4fad-9b90-c7b9003301d0) Jun 26 02:49:52.798039 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_7a0a7fdd73fc40328c4c73ef53edc697 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:49:52.798204 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:49:52.798603 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:49:52.808366 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:49:52.826624 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:49:52.841648 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:49:52.841946 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:49:52.863136 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:49:52.863136 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe06:4738', 'fe80::fc16:3eff:feb5:b10f'] Jun 26 02:49:52.863136 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:49:52.863136 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:49:52.863136 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] <== get_connector_properties: return (55ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:49:52.956464 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:52.956688 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:53.068968 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:53.069653 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:53.112276 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:49:53.255760 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.204s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:49:53.255760 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] <== connect_volume: return (2204ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799055', 'path': '/dev/sdb'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:49:53.255760 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:49:53.278232 np0000003683 sudo[139521]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jun 26 02:49:53.278984 np0000003683 sudo[139521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:49:53.317741 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:53.359101 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:49:53.359647 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:49:53.359846 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:49:53.612986 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:53.613452 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:53.641640 np0000003683 sudo[139521]: pam_unix(sudo:session): session closed for user root Jun 26 02:49:53.644713 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.389s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:49:53.657806 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] _create_container started, container: volumebackups,backup: 6c5d1cb3-89cc-4e89-b511-239c7326c849. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:49:53.725685 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.366s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:49:53.725959 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:49:53.737568 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:49:53.738013 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:49:53.738370 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:49:53.740874 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:53.741003 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:53.753599 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:49:53.753599 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:53.771732 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0] added Jun 26 02:49:53.771732 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:49:53.771732 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:49:53.771732 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:49:53.771732 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:49:53.771732 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:49:53.771732 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:53.771732 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:49:53.773293 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:49:53.773293 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:49:53.839137 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] generate_object_name_prefix: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849 {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:49:53.850066 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] starting backup of volume: 8841aced-68ba-467f-bbc7-c77bc02c0152, volume size: 1073741824, object names prefix volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:49:54.058180 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:54.082019 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:54.306904 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:54.307101 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:54.346915 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:54.347161 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:54.413266 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:54.413540 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:54.461562 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:54.461766 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:54.676559 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:54.724429 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:54.776916 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:49:54.795906 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:54.808153 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:54.826740 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:54.826740 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:54.826740 np0000003683 cinder-backup[101221]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash) Jun 26 02:49:54.826740 np0000003683 cinder-backup[101221]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash) Jun 26 02:49:54.826740 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:54.826740 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:54.826740 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:54.826740 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:54.826740 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:54.826740 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:54.826740 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:54.827005 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:54.827005 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:54.827005 np0000003683 cinder-backup[101221]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash) Jun 26 02:49:54.827005 np0000003683 cinder-backup[101221]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash) Jun 26 02:49:54.827005 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:54.827005 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:54.827005 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:54.827005 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:54.827005 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:54.827005 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:54.827005 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:49:54.872973 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, portal: 192.168.40.100,3260] Jun 26 02:49:54.872973 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, portal: 192.168.40.100,3260] successful. Jun 26 02:49:54.872973 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:54.886116 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:54.903639 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:54.903639 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:54.903639 np0000003683 cinder-backup[101221]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash) Jun 26 02:49:54.903639 np0000003683 cinder-backup[101221]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash) Jun 26 02:49:54.903639 np0000003683 cinder-backup[101221]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:49:54.903639 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:54.903639 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:54.903639 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:54.903639 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:54.903639 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:54.903639 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:54.903639 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:54.904086 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:54.904086 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:54.904086 np0000003683 cinder-backup[101221]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash) Jun 26 02:49:54.904086 np0000003683 cinder-backup[101221]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash) Jun 26 02:49:54.904086 np0000003683 cinder-backup[101221]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:49:54.904086 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:54.904086 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:54.904086 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:54.904086 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:54.904086 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:54.904086 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:54.904086 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:49:54.904500 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:49:54.904500 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:49:54.905437 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] HCTL ('15', '-', '-', 0) found on session 113 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:49:54.905588 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Scanning host 15 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:49:54.918211 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Searching for a device in session 113 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:49:54.918211 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:49:54.952693 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:54.952934 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:54.996735 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:54.996735 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:55.066809 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:55.067002 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:55.125984 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:55.126158 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:55.432755 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:55.449059 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:55.695972 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:55.696379 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:55.696379 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:55.696456 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:55.804177 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:55.804385 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:55.817803 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:55.817974 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:55.924534 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.197s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:49:55.924866 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] <== connect_volume: return (2563ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799057', 'path': '/dev/sdj'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:49:55.925842 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:49:55.953393 np0000003683 sudo[139692]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj Jun 26 02:49:55.954295 np0000003683 sudo[139692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:49:56.125048 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:56.170694 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:56.320352 np0000003683 sudo[139692]: pam_unix(sudo:session): session closed for user root Jun 26 02:49:56.322295 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj" returned: 0 in 0.397s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:49:56.333955 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] _create_container started, container: volumebackups,backup: 5464cf72-b70d-4129-ba1b-1c34c4c31aae. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:49:56.375318 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] generate_object_name_prefix: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:49:56.381439 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] starting backup of volume: a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, volume size: 1073741824, object names prefix volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:49:56.388549 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:56.388695 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:56.437965 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:56.438131 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:56.514160 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:56.514413 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:56.545006 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:56.545161 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:56.700856 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:56.714893 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:56.825421 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:56.880998 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:56.881158 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:56.949935 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup MD5 for volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:56.950449 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:56.958179 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:49:56.965287 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:49:56.965417 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:49:56.969846 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:49:56.970035 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:49:56.973789 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:49:56.974092 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] _write_sha256file started, container name: tempest-volumesbackupsv39test-backup-container-1152892557, sha256file filename: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:49:57.044369 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:49:57.045050 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] _write_metadata started, container name: tempest-volumesbackupsv39test-backup-container-1152892557, metadata filename: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:49:57.073985 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "ea0b2670-f73d-4d09-a2ed-e5b09a67ef16",\n "backup_name": "tempest-VolumesBackupsV39Test-Backup-287824265",\n "created_at": "2026-06-26 02:49:39+00:00",\n "objects": [\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "6a4b4d30-68ae-4952-8c21-d5360ffcd7bc",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"6a4b4d30-68ae-4952-8c21-d5360ffcd7bc\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"26eab4a53e0d4a9fa6e211fe27f9eb3c\\", \\"project_id\\": \\"5b9fe6eb6628444689f26c19cf7c3c7f\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:49:38.000000\\", \\"launched_at\\": \\"2026-06-26T02:49:38.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsV39Test-Volume-1652297000\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:49:38.000000\\", \\"updated_at\\": \\"2026-06-26T02:49:39.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:49:57.078561 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] backup ea0b2670-f73d-4d09-a2ed-e5b09a67ef16 finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:49:57.212563 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:49:57.224184 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:57.224443 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:57.235402 np0000003683 sudo[139699]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Jun 26 02:49:57.236034 np0000003683 sudo[139699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:49:57.337847 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:57.338037 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:57.486821 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 19825286 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:57.486950 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:57.572439 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:57.624999 np0000003683 sudo[139699]: pam_unix(sudo:session): session closed for user root Jun 26 02:49:57.628075 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.415s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:49:57.628946 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a4b4d30-68ae-4952-8c21-d5360ffcd7bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799053', 'path': '/dev/sdc'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:49:57.629216 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:49:57.629673 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:49:57.632290 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a4b4d30-68ae-4952-8c21-d5360ffcd7bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:49:57.647441 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:57.649412 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:49:57.649412 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:49:57.649412 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:49:57.649412 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:49:57.676785 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:57.676785 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:57.676785 np0000003683 cinder-backup[101221]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash) Jun 26 02:49:57.676785 np0000003683 cinder-backup[101221]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash) Jun 26 02:49:57.676785 np0000003683 cinder-backup[101221]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:49:57.676785 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:57.676785 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:57.676785 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:57.676785 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:57.676785 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:57.676785 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:57.676785 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:49:57.677427 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:57.677427 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:49:57.677427 np0000003683 cinder-backup[101221]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc (non-flash) Jun 26 02:49:57.677427 np0000003683 cinder-backup[101221]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash) Jun 26 02:49:57.677427 np0000003683 cinder-backup[101221]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:49:57.677427 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:57.677427 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:49:57.677427 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:57.677427 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:49:57.677427 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:57.677427 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:49:57.677427 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:49:57.677427 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152', '112'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:49:57.677427 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc', '111')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:49:57.682768 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Resulting device map defaultdict(. at 0x79db5a7d79c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc'): ({'sdc'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:49:57.683020 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Removing single pathed devices sdc {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:49:57.693324 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Flushing IO for device /dev/sdc {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:49:57.702316 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:49:57.743719 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00001: 82571f7121cb9475563edde615e4e4df {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:57.743931 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:57.757720 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:49:57.757947 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] SCSI volumes sdc have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:49:57.761196 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Checking to see if device paths {'sdc'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:49:57.775127 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Device paths {'sdc'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:49:57.775385 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:49:57.794591 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:57.839719 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:57.839846 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:57.849798 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 111, target: iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc, portal: 192.168.40.100,3260] Jun 26 02:49:57.849798 np0000003683 cinder-backup[101221]: Logout of [sid: 111, target: iqn.2023-03.storpool.com:os--volume-6a4b4d30-68ae-4952-8c21-d5360ffcd7bc, portal: 192.168.40.100,3260] successful. Jun 26 02:49:57.849798 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:57.874846 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:49:57.875187 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.245s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:49:57.875424 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] <== disconnect_volume: return (246ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:49:57.978370 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:57.984063 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:57.984287 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:58.213455 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:58.244789 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:58.244961 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:58.354198 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:58.354418 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:58.573639 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:58.573639 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:58.582146 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:58.695988 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:58.696247 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:58.873912 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 1362154 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:58.874375 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:58.911580 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-e6400662-1abf-4a0a-bf81-15b58e198038 tempest-VolumesBackupsV39Test-1304519808 None] Create backup finished. backup: ea0b2670-f73d-4d09-a2ed-e5b09a67ef16. Jun 26 02:49:58.912309 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:58.991532 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00003: a35891500449df17e893f84bd88472fb {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:58.991784 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:59.163650 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:59.163856 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:59.186446 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:59.273038 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:59.273220 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:59.444776 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:59.444898 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:59.451301 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:59.550241 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:59.550492 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:49:59.760213 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:49:59.807131 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:49:59.807361 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:49:59.920165 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:49:59.920491 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:00.029037 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:00.029037 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:00.041373 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] Delete backup started, backup: ea0b2670-f73d-4d09-a2ed-e5b09a67ef16. Jun 26 02:50:00.046731 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_5b9fe6eb6628444689f26c19cf7c3c7f {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:50:00.047064 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:50:00.047403 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] delete started, backup: ea0b2670-f73d-4d09-a2ed-e5b09a67ef16, container: tempest-volumesbackupsv39test-backup-container-1152892557, prefix: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:50:00.104637 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] generated object list: ['volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00001', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00002', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00003', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00004', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00005', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00006', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00007', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00008', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00009', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00010', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00011', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00012', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00013', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00014', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00015', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00016', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00017', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00018', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00019', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00020', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00021', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16_metadata', 'volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:50:00.126597 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00001 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.133208 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:00.147047 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:00.147226 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:00.174325 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00002 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.183113 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:50:00.199063 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00003 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.225645 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00004 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.257570 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00005 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.284284 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00006 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.312987 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00007 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.340921 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00008 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.365108 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00009 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.390081 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:00.390266 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:00.392537 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00010 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.418065 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:00.421989 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00011 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.441047 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00012 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.462246 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00013 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.480293 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00014 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.498805 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00015 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.518526 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:00.518683 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:00.522877 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00016 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.542798 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00017 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.563965 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00018 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.587596 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00019 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.608033 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00020 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.629825 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16-00021 in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.651538 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16_metadata in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.678446 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] deleted object: volume_6a4b4d30-68ae-4952-8c21-d5360ffcd7bc/20260626024943/az_nova_backup_ea0b2670-f73d-4d09-a2ed-e5b09a67ef16_sha256file in container: tempest-volumesbackupsv39test-backup-container-1152892557. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:00.678646 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] delete ea0b2670-f73d-4d09-a2ed-e5b09a67ef16 finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:50:00.697555 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:00.697752 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:00.700683 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] Created reservations ['3f9f9297-4aaf-4f16-940c-ed7423506dc3', 'a59e7cc4-e756-4112-89ba-a858a0b88056'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:50:00.717251 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-54d1de29-605b-476c-a1bf-b07072b73ec9 tempest-VolumesBackupsV39Test-1304519808 None] Delete backup finished, backup ea0b2670-f73d-4d09-a2ed-e5b09a67ef16 deleted. Jun 26 02:50:00.764527 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:00.817180 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:00.817419 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:01.008063 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:01.014162 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:01.014430 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:01.130822 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:01.131044 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:01.280944 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:01.281083 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:01.393090 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:01.393349 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:01.449751 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:01.617634 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:01.709955 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:01.710234 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:01.816342 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:01.816590 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:01.868273 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:01.868513 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:01.994621 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:01.995051 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:02.028249 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:02.233399 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:02.282389 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:02.282586 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:02.389859 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:02.390050 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:02.492938 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:02.492938 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:02.586590 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:02.613170 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:02.613359 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:02.819098 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:02.864051 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:02.864051 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:02.974459 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:02.975794 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:03.104174 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:03.104598 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:03.226224 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:03.239654 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:03.239834 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:03.465176 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:03.496446 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:03.496676 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:03.616075 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:03.616300 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:03.728563 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:03.728700 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:03.848272 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:03.848513 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:03.877173 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:04.068583 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:04.157877 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:04.158195 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:04.260977 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:04.261155 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:04.327121 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:04.327121 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:04.438337 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:04.438720 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:04.481652 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:04.633974 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:04.726432 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:04.726669 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:04.845038 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:04.845038 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:04.905111 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:04.905195 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:05.022540 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:05.022744 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:05.111709 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:05.259025 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:05.380875 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:05.381033 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:05.483868 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:05.483990 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:05.524274 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:05.524537 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:05.639061 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:05.639316 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:05.719028 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:05.871776 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:05.972940 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:05.973150 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:06.087388 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:06.087578 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:06.114200 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:06.114200 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:06.222306 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:06.222492 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:06.320556 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:06.480729 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:06.580512 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:06.580754 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:06.688048 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:06.688310 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:06.738145 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:06.738145 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:06.808606 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:06.846098 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:06.846303 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:06.937973 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:06.938176 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:07.025521 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:07.026396 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:07.038975 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:50:07.050333 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:50:07.050648 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:50:07.055696 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:50:07.055841 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:50:07.059170 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:50:07.059412 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:50:07.123733 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:50:07.124517 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] _write_metadata started, container name: volumebackups, metadata filename: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:50:07.140153 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:07.158490 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "6c5d1cb3-89cc-4e89-b511-239c7326c849",\n "backup_name": "tempest-VolumesBackupsTest-Backup-56543245",\n "created_at": "2026-06-26 02:49:50+00:00",\n "objects": [\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "8841aced-68ba-467f-bbc7-c77bc02c0152",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"8841aced-68ba-467f-bbc7-c77bc02c0152\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"76814a8561f64788a98990bb48923696\\", \\"project_id\\": \\"56301a4e8d3e4c228f3a24467568fd7b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:49:49.000000\\", \\"launched_at\\": \\"2026-06-26T02:49:49.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-272816524\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:49:49.000000\\", \\"updated_at\\": \\"2026-06-26T02:49:50.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:50:07.165813 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] backup 6c5d1cb3-89cc-4e89-b511-239c7326c849 finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:50:07.302040 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:50:07.329430 np0000003683 sudo[139930]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jun 26 02:50:07.330377 np0000003683 sudo[139930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:50:07.421639 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:07.421950 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:07.543187 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:07.545033 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:07.750396 np0000003683 sudo[139930]: pam_unix(sudo:session): session closed for user root Jun 26 02:50:07.753399 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.450s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:50:07.753399 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8841aced-68ba-467f-bbc7-c77bc02c0152', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799055', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:50:07.753399 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:50:07.754303 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:50:07.754809 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8841aced-68ba-467f-bbc7-c77bc02c0152', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:50:07.772765 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:50:07.774219 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:50:07.774219 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:50:07.774219 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:50:07.774428 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:50:07.804819 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:07.818610 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:07.818610 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:07.818610 np0000003683 cinder-backup[101221]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash) Jun 26 02:50:07.818610 np0000003683 cinder-backup[101221]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:07.818610 np0000003683 cinder-backup[101221]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:07.818610 np0000003683 cinder-backup[101221]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:07.818610 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:07.818610 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:07.818610 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:50:07.818610 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:50:07.818610 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:07.818610 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:07.818610 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:50:07.819197 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:07.819197 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:07.819197 np0000003683 cinder-backup[101221]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152 (non-flash) Jun 26 02:50:07.819197 np0000003683 cinder-backup[101221]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:07.819197 np0000003683 cinder-backup[101221]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:07.819197 np0000003683 cinder-backup[101221]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:07.819197 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:07.819197 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:07.819197 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:50:07.819197 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:50:07.819197 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:07.819197 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:07.819197 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:50:07.819871 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152', '112'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:50:07.820118 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152', '112')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:50:07.821407 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Resulting device map defaultdict(. at 0x79db5ab7efc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152'): ({'sdb'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:50:07.821726 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Removing single pathed devices sdb {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:50:07.834396 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Flushing IO for device /dev/sdb {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:50:07.841947 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:50:07.889065 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:50:07.889419 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] SCSI volumes sdb have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:50:07.891507 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:50:07.904408 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:50:07.904768 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:50:07.920032 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:07.963765 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 112, target: iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152, portal: 192.168.40.100,3260] Jun 26 02:50:07.963765 np0000003683 cinder-backup[101221]: Logout of [sid: 112, target: iqn.2023-03.storpool.com:os--volume-8841aced-68ba-467f-bbc7-c77bc02c0152, portal: 192.168.40.100,3260] successful. Jun 26 02:50:07.963765 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:07.986703 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:07.986985 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.233s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:50:07.987191 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] <== disconnect_volume: return (234ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:50:08.069120 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:08.069410 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:08.175271 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:08.175271 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:08.445968 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:08.731766 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:08.731992 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:08.849796 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:08.849973 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:09.020439 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-9314f788-5e7b-455e-a100-86847039aa91 tempest-VolumesBackupsTest-665014974 None] Create backup finished. backup: 6c5d1cb3-89cc-4e89-b511-239c7326c849. Jun 26 02:50:09.057429 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:09.313247 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:09.313379 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:09.424640 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:09.424747 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:09.523776 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:09.647396 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:09.647577 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:09.714501 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:09.714767 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:09.723589 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:50:09.731599 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:50:09.731599 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:50:09.735623 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:50:09.736073 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:50:09.740254 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jun 26 02:50:09.740555 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:50:09.824716 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:50:09.825429 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] _write_metadata started, container name: volumebackups, metadata filename: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:50:09.864774 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "5464cf72-b70d-4129-ba1b-1c34c4c31aae",\n "backup_name": "tempest-VolumesBackupsTest-Backup-411784569",\n "created_at": "2026-06-26 02:49:53+00:00",\n "objects": [\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "82571f7121cb9475563edde615e4e4df",\n "offset": 0\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "a35891500449df17e893f84bd88472fb",\n "offset": 104857600\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "a5fbcabf-ce3a-4fad-9b90-c7b9003301d0",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"a5fbcabf-ce3a-4fad-9b90-c7b9003301d0\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"6abcc90720de4d3e8d49aa5c4bb02b11\\", \\"project_id\\": \\"7a0a7fdd73fc40328c4c73ef53edc697\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:49:52.000000\\", \\"launched_at\\": \\"2026-06-26T02:49:52.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-2017360747\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:49:52.000000\\", \\"updated_at\\": \\"2026-06-26T02:49:53.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"eb0918cd-17b7-4dc6-8a46-002286996c07\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:50:09.872049 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] backup 5464cf72-b70d-4129-ba1b-1c34c4c31aae finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:50:10.011859 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:50:10.033487 np0000003683 sudo[140045]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj Jun 26 02:50:10.034155 np0000003683 sudo[140045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:50:10.132982 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] Delete backup started, backup: 6c5d1cb3-89cc-4e89-b511-239c7326c849. Jun 26 02:50:10.139590 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_56301a4e8d3e4c228f3a24467568fd7b {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:50:10.139751 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:50:10.139983 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] delete started, backup: 6c5d1cb3-89cc-4e89-b511-239c7326c849, container: volumebackups, prefix: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:50:10.197069 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] generated object list: ['volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00001', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00002', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00003', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00004', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00005', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00006', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00007', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00008', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00009', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00010', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00011', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00012', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00013', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00014', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00015', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00016', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00017', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00018', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00019', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00020', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00021', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849_metadata', 'volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:50:10.217645 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00001 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.240371 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00002 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.266507 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00003 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.294662 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00004 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.317981 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00005 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.342748 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00006 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.363315 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00007 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.387668 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00008 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.398148 np0000003683 sudo[140045]: pam_unix(sudo:session): session closed for user root Jun 26 02:50:10.400153 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj" returned: 0 in 0.388s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:50:10.400794 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799057', 'path': '/dev/sdj'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:50:10.401026 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:50:10.401629 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:50:10.401970 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:50:10.407577 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00009 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:50:10.414802 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:50:10.415569 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:50:10.415569 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:50:10.415569 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:50:10.415569 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:50:10.430390 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00010 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.446799 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:10.446799 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:10.446799 np0000003683 cinder-backup[101221]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:10.446799 np0000003683 cinder-backup[101221]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:10.446799 np0000003683 cinder-backup[101221]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:10.446799 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:10.446799 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:10.446799 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:50:10.446799 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:50:10.446799 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:10.446799 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:10.446799 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:50:10.447275 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:10.447275 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:10.447275 np0000003683 cinder-backup[101221]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:10.447275 np0000003683 cinder-backup[101221]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:10.447275 np0000003683 cinder-backup[101221]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:10.447275 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:10.447275 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:10.447275 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:50:10.447275 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:50:10.447275 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:10.447275 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:10.447275 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:50:10.447275 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:50:10.447275 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '113')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:50:10.448731 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Resulting device map defaultdict(. at 0x79db78f43f60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0'): ({'sdj'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:50:10.448987 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Removing single pathed devices sdj {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:50:10.451756 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00011 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.462049 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Flushing IO for device /dev/sdj {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:50:10.470953 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:50:10.475154 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00012 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.496889 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00013 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.514947 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00014 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.528025 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Checking to see if SCSI volumes sdj have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:50:10.528401 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] SCSI volumes sdj have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:50:10.530903 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Checking to see if device paths {'sdj'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:50:10.540444 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00015 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.543030 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Device paths {'sdj'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:50:10.544012 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:50:10.557298 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:10.561405 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00016 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.581592 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00017 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.598096 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 113, target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, portal: 192.168.40.100,3260] Jun 26 02:50:10.598096 np0000003683 cinder-backup[101221]: Logout of [sid: 113, target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, portal: 192.168.40.100,3260] successful. Jun 26 02:50:10.598096 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:10.603595 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00018 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.619370 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:10.619646 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.218s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:50:10.619850 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] <== disconnect_volume: return (219ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:50:10.629158 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00019 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.649371 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00020 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.679017 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849-00021 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.703310 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849_metadata in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.727379 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_8841aced-68ba-467f-bbc7-c77bc02c0152/20260626024953/az_nova_backup_6c5d1cb3-89cc-4e89-b511-239c7326c849_sha256file in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:10.727379 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] delete 6c5d1cb3-89cc-4e89-b511-239c7326c849 finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:50:10.765049 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:50:10.780014 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] Created reservations ['0421f9be-28ce-4ca0-b4ff-e318c5574d2e', '53c15ba5-6303-4c5a-893c-4fe1f0adecb5'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:50:10.793994 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-4b98a787-bfe6-4979-85ac-405607f87457 tempest-VolumesBackupsTest-665014974 None] Delete backup finished, backup 6c5d1cb3-89cc-4e89-b511-239c7326c849 deleted. Jun 26 02:50:11.636634 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-950ce86f-2f62-4c11-b64e-3e8bebaaff55 tempest-VolumesBackupsTest-232973889 None] Create backup finished. backup: 5464cf72-b70d-4129-ba1b-1c34c4c31aae. Jun 26 02:50:12.615763 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Create backup started, backup: c76d0b5a-0a09-46d9-b969-34b20e9cbe73 volume: 43c44842-f131-499c-bfab-b352d35ae75a. Jun 26 02:50:12.621654 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-06-26T02:50:12Z,data_timestamp=2026-06-26T02:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-966647535',encryption_key_id=None,fail_reason=None,host='np0000003683',id=c76d0b5a-0a09-46d9-b969-34b20e9cbe73,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='ec9765c5e68d4391876fe64b00b50ea0',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='7c2cdba6cd9c40a4a9c4aae763ca1711',volume_id=43c44842-f131-499c-bfab-b352d35ae75a) Jun 26 02:50:12.644904 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_ec9765c5e68d4391876fe64b00b50ea0 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:50:12.645306 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:50:12.645663 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:50:12.656678 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:50:12.674366 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:50:12.687088 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:50:12.687697 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:50:12.694771 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:50:12.694976 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:50:12.697792 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:50:12.698985 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe06:4738', 'fe80::fc16:3eff:feb5:b10f', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:fe18:269', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c'] Jun 26 02:50:12.699190 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:50:12.699373 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:50:12.699682 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] <== get_connector_properties: return (53ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:50:13.208739 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:50:13.210420 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43c44842-f131-499c-bfab-b352d35ae75a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:50:13.210694 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:50:13.211278 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:50:13.211536 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43c44842-f131-499c-bfab-b352d35ae75a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:50:13.222516 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:50:13.223271 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:50:13.223599 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:50:13.234719 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:50:13.234719 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:13.245514 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a] added Jun 26 02:50:13.245514 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:50:13.245514 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:50:13.245514 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:50:13.245514 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:50:13.245514 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:50:13.245514 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:13.245893 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:50:13.246454 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0228(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:50:13.246731 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:50:14.247887 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:50:14.262023 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:14.272725 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:14.288326 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:14.288326 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:14.288326 np0000003683 cinder-backup[101221]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:14.288326 np0000003683 cinder-backup[101221]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:14.288326 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:14.288326 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:14.288326 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:50:14.288326 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:50:14.288326 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:14.288326 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:14.288326 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:50:14.288652 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:14.288652 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:14.288652 np0000003683 cinder-backup[101221]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:14.288652 np0000003683 cinder-backup[101221]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:14.288652 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:14.288652 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:14.288652 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:50:14.288652 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:50:14.288652 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:14.288652 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:14.288652 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:50:14.338945 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a, portal: 192.168.40.100,3260] Jun 26 02:50:14.338945 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a, portal: 192.168.40.100,3260] successful. Jun 26 02:50:14.338945 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:14.350879 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e69043-4f4b-47f3-b252-4718d5d2e28b (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:14.371806 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:50:14.372905 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:50:14.372905 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:50:14.373445 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] HCTL ('7', '-', '-', 0) found on session 116 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:50:14.373445 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:50:14.385387 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Searching for a device in session 116 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:50:14.385690 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43c44842-f131-499c-bfab-b352d35ae75a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:50:15.389397 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.178s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:50:15.389811 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] <== connect_volume: return (2178ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799064', 'path': '/dev/sdb'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:50:15.390043 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:50:15.409730 np0000003683 sudo[140199]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jun 26 02:50:15.410397 np0000003683 sudo[140199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:50:15.733293 np0000003683 sudo[140199]: pam_unix(sudo:session): session closed for user root Jun 26 02:50:15.735402 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.345s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:50:15.769862 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:50:15.775082 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] _create_container started, container: volumebackups,backup: c76d0b5a-0a09-46d9-b969-34b20e9cbe73. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:50:15.982234 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] generate_object_name_prefix: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73 {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:50:15.994833 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] starting backup of volume: 43c44842-f131-499c-bfab-b352d35ae75a, volume size: 1073741824, object names prefix volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:50:16.197947 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:16.449718 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:16.450132 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:16.557281 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:16.557446 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:16.736372 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:16.988340 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:16.988491 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:17.086679 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:17.086848 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:17.296133 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:17.539182 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:17.539616 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:17.636805 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:17.636951 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:17.821028 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:18.069941 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:18.070149 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:18.171030 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:18.171187 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:18.373388 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:18.621124 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:18.621467 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:18.734823 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:18.734958 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:18.925358 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:19.174233 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:19.174398 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:19.278380 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:19.278584 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:19.511812 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:19.768958 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:19.769370 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:19.883811 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:19.883890 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:20.112178 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:20.376202 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:20.376548 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:20.492182 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:20.492341 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:20.690594 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:20.952127 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:20.953453 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:21.060045 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:21.060318 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:21.296037 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:21.554069 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:21.554069 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:21.667083 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:21.667083 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:21.885388 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:22.144707 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:22.145298 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:22.252504 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:22.252504 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:22.252504 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:UPDATE=59,cinder:SELECT=199,cinder:INSERT=8 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:50:22.457527 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:22.716429 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:22.716429 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:22.818609 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:22.818768 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:23.025145 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:23.271236 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:23.272603 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:23.389260 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:23.390401 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:23.584989 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:23.847139 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:23.847139 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:23.963703 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:23.963703 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:24.183990 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:24.433462 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:24.433462 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:24.534988 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:24.536659 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:24.793912 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:25.052192 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:25.052417 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:25.174187 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:25.174187 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:25.400435 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:25.681629 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:25.682020 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:25.801959 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:25.802122 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:26.001614 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:26.254027 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:26.254219 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:26.360564 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:26.360793 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:26.543953 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:26.797771 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:26.797771 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:26.897492 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:26.897701 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:27.085232 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:27.333565 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:27.333740 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:27.436406 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:27.436653 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:27.551686 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:27.673631 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:27.673832 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:27.735027 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:27.735241 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:27.741894 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:50:27.746583 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:50:27.746770 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:50:27.751050 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:50:27.751242 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:50:27.754269 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:50:27.754570 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:50:27.813916 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:50:27.814836 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] _write_metadata started, container name: volumebackups, metadata filename: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:50:27.837865 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "c76d0b5a-0a09-46d9-b969-34b20e9cbe73",\n "backup_name": "tempest-VolumesBackupsTest-Backup-966647535",\n "created_at": "2026-06-26 02:50:13+00:00",\n "objects": [\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "43c44842-f131-499c-bfab-b352d35ae75a",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"43c44842-f131-499c-bfab-b352d35ae75a\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"76814a8561f64788a98990bb48923696\\", \\"project_id\\": \\"56301a4e8d3e4c228f3a24467568fd7b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:50:11.000000\\", \\"launched_at\\": \\"2026-06-26T02:50:12.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-249002707\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:50:11.000000\\", \\"updated_at\\": \\"2026-06-26T02:50:13.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:50:27.847303 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] backup c76d0b5a-0a09-46d9-b969-34b20e9cbe73 finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:50:27.977844 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:50:27.995872 np0000003683 sudo[140596]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jun 26 02:50:27.996469 np0000003683 sudo[140596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:50:28.354411 np0000003683 sudo[140596]: pam_unix(sudo:session): session closed for user root Jun 26 02:50:28.357387 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.378s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:50:28.357691 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43c44842-f131-499c-bfab-b352d35ae75a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799064', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:50:28.357990 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:50:33.631642 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.274s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:50:33.632177 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43c44842-f131-499c-bfab-b352d35ae75a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:50:33.646458 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:50:33.647360 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:50:33.647360 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:50:33.647360 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:50:33.647360 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:50:33.680547 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:33.680547 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:33.680547 np0000003683 cinder-backup[101221]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash) Jun 26 02:50:33.680547 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:33.680547 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:33.680547 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:33.680547 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:33.680547 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:33.680547 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:33.680547 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:33.680547 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:33.680547 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:33.680547 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:33.680547 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:50:33.681133 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:33.681133 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:33.681133 np0000003683 cinder-backup[101221]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a (non-flash) Jun 26 02:50:33.681133 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:33.681133 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:33.681133 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:33.681133 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:33.681133 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:33.681133 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:33.681133 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:33.681133 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:33.681133 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:33.681133 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:33.681133 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:50:33.681674 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:50:33.682129 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a', '116')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:50:33.683588 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Resulting device map defaultdict(. at 0x79db5ac74360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a'): ({'sdb'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:50:33.683854 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Removing single pathed devices sdb {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:50:33.697079 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Flushing IO for device /dev/sdb {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:50:33.704506 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:50:33.760457 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:50:33.760682 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] SCSI volumes sdb have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:50:33.762293 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:50:33.772201 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:50:33.772448 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:50:33.787941 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:33.826683 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 116, target: iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a, portal: 192.168.40.100,3260] Jun 26 02:50:33.826683 np0000003683 cinder-backup[101221]: Logout of [sid: 116, target: iqn.2023-03.storpool.com:os--volume-43c44842-f131-499c-bfab-b352d35ae75a, portal: 192.168.40.100,3260] successful. Jun 26 02:50:33.826683 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:33.847368 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:33.847667 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.216s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:50:33.847833 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] <== disconnect_volume: return (5490ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:50:34.884945 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-875b41b7-4c11-4718-a7f4-5d8c4c00ebba tempest-VolumesBackupsTest-2142713548 None] Create backup finished. backup: c76d0b5a-0a09-46d9-b969-34b20e9cbe73. Jun 26 02:50:35.176452 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] Delete backup started, backup: c76d0b5a-0a09-46d9-b969-34b20e9cbe73. Jun 26 02:50:35.187132 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_ec9765c5e68d4391876fe64b00b50ea0 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:50:35.187349 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:50:35.187599 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] delete started, backup: c76d0b5a-0a09-46d9-b969-34b20e9cbe73, container: volumebackups, prefix: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:50:35.235377 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] generated object list: ['volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00001', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00002', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00003', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00004', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00005', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00006', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00007', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00008', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00009', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00010', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00011', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00012', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00013', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00014', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00015', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00016', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00017', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00018', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00019', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00020', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00021', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73_metadata', 'volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:50:35.260316 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00001 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.289008 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00002 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.315115 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00003 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.338459 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00004 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.358217 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00005 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.387299 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00006 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.406874 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00007 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.435231 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00008 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.459468 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00009 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.482583 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00010 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.504102 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00011 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.526704 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00012 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.551631 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00013 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.574129 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00014 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.593671 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00015 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.616031 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00016 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.645284 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00017 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.676821 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00018 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.704107 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00019 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.726119 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00020 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.750270 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73-00021 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.779443 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73_metadata in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.805244 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_43c44842-f131-499c-bfab-b352d35ae75a/20260626025015/az_nova_backup_c76d0b5a-0a09-46d9-b969-34b20e9cbe73_sha256file in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:50:35.805502 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] delete c76d0b5a-0a09-46d9-b969-34b20e9cbe73 finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:50:35.854265 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:50:35.878889 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] Created reservations ['fb9b9058-5f84-4ab3-867e-e8897d9e9f4b', '8b57cd88-a42e-435b-9af2-d6aecb949ee2'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:50:35.895585 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-a6c8a0ec-c5ca-4dba-bd25-b8957e5b3459 tempest-VolumesBackupsTest-2142713548 None] Delete backup finished, backup c76d0b5a-0a09-46d9-b969-34b20e9cbe73 deleted. Jun 26 02:50:37.659107 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Create backup started, backup: 7792e7e4-153e-4c91-b651-a76c2b10d1f7 volume: 1ccea677-9f74-4cf7-b159-cf84d9345e2e. Jun 26 02:50:37.665886 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-06-26T02:50:37Z,data_timestamp=2026-06-26T02:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-2139423736',encryption_key_id=None,fail_reason=None,host='np0000003683',id=7792e7e4-153e-4c91-b651-a76c2b10d1f7,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='ec9765c5e68d4391876fe64b00b50ea0',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='7c2cdba6cd9c40a4a9c4aae763ca1711',volume_id=1ccea677-9f74-4cf7-b159-cf84d9345e2e) Jun 26 02:50:37.702011 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_ec9765c5e68d4391876fe64b00b50ea0 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:50:37.702285 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:50:37.702834 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:50:37.716096 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:50:37.742072 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:50:37.758450 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:50:37.758842 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:50:37.767973 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:50:37.772281 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe06:4738', 'fe80::fc16:3eff:feb5:b10f', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:fe18:269', 'fe80::fc16:3eff:fef8:d9e0', 'fe80::5008:6cff:fe61:eb31', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fe1f:2cfe'] Jun 26 02:50:37.772281 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:50:37.772281 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:50:37.772281 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] <== get_connector_properties: return (68ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:50:38.276868 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:50:38.277324 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:50:38.277536 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:50:39.636504 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.359s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:50:39.636946 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:50:39.650567 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:50:39.651071 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:50:39.651387 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:50:39.662403 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:50:39.662403 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:39.672866 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e] added Jun 26 02:50:39.672866 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:50:39.672866 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:50:39.672866 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:50:39.672866 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:50:39.672866 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:50:39.672866 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:39.673167 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:50:39.673619 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0222(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:50:39.673861 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:50:40.676046 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:50:40.689121 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:40.702075 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:40.722177 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:50:40.783180 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, portal: 192.168.40.100,3260] Jun 26 02:50:40.783180 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, portal: 192.168.40.100,3260] successful. Jun 26 02:50:40.783180 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:40.795505 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:40.813576 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:40.813576 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:40.813576 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:40.813576 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:40.813576 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:40.813576 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:40.813576 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:40.813576 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:40.813576 np0000003683 cinder-backup[101221]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:40.813576 np0000003683 cinder-backup[101221]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:40.813576 np0000003683 cinder-backup[101221]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:50:40.813576 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:40.813576 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:40.813576 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:40.813576 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:40.813576 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:50:40.813907 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:40.813907 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:40.813907 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:40.813907 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:40.813907 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:40.813907 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:40.813907 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:40.813907 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:40.813907 np0000003683 cinder-backup[101221]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:40.813907 np0000003683 cinder-backup[101221]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:40.813907 np0000003683 cinder-backup[101221]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:50:40.813907 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:40.813907 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:40.813907 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:40.813907 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:40.813907 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:50:40.814215 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:50:40.814267 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:50:40.815586 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] HCTL ('10', '-', '-', 0) found on session 125 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:50:40.815735 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Scanning host 10 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:50:40.833966 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Searching for a device in session 125 and hctl ['10', '*', '*', 0] yield: sde {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:50:40.833966 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:50:41.838367 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.202s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:50:41.838367 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] <== connect_volume: return (3560ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799080', 'path': '/dev/sde'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:50:41.839086 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:50:41.858065 np0000003683 sudo[141487]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde Jun 26 02:50:41.858772 np0000003683 sudo[141487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:50:42.261804 np0000003683 sudo[141487]: pam_unix(sudo:session): session closed for user root Jun 26 02:50:42.263902 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde" returned: 0 in 0.425s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:50:42.313361 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:50:42.320586 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] _create_container started, container: volumebackups,backup: 7792e7e4-153e-4c91-b651-a76c2b10d1f7. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:50:42.357468 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] generate_object_name_prefix: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7 {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:50:42.362650 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] starting backup of volume: 1ccea677-9f74-4cf7-b159-cf84d9345e2e, volume size: 1073741824, object names prefix volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:50:42.592563 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:42.872174 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:42.872817 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:42.989598 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:42.990884 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:43.248127 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:43.272006 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Create backup started, backup: a31b0af3-25cc-485a-9899-b476cff3fd4f volume: e1d6f62f-72e0-42df-a20e-cf29b92618e0. Jun 26 02:50:43.277500 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-1969770382',created_at=2026-06-26T02:50:43Z,data_timestamp=2026-06-26T02:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1637006421',encryption_key_id=None,fail_reason=None,host='np0000003683',id=a31b0af3-25cc-485a-9899-b476cff3fd4f,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c05f689c58a04254b3930f0cc279148c',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3f08f0507eec40189b858129b4cc7fd1',volume_id=e1d6f62f-72e0-42df-a20e-cf29b92618e0) Jun 26 02:50:43.396115 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_c05f689c58a04254b3930f0cc279148c {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:50:43.396638 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:50:43.396891 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:50:43.409504 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:50:43.435182 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:50:43.455703 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:50:43.456741 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:50:43.463847 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:50:43.465535 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe06:4738', 'fe80::fc16:3eff:feb5:b10f', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:fe18:269', 'fe80::fc16:3eff:fef8:d9e0', 'fe80::5008:6cff:fe61:eb31', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fe1f:2cfe'] Jun 26 02:50:43.465704 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:50:43.465704 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:50:43.465943 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] <== get_connector_properties: return (69ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:50:43.550685 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:43.550794 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:43.673334 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:43.673658 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:43.729928 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:50:43.951058 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:43.970732 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:50:43.971084 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6264d4-fda5-450d-87e7-c406f1d8d734', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:50:43.971255 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:50:43.971660 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:50:43.971845 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6264d4-fda5-450d-87e7-c406f1d8d734', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:50:43.982232 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:50:43.982603 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:50:43.982831 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:50:43.992606 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:50:43.992606 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:44.005092 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734] added Jun 26 02:50:44.005092 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:50:44.005092 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:50:44.005092 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:50:44.005092 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:50:44.005092 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:50:44.005092 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:44.005349 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:50:44.005773 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0228(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:50:44.006005 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:50:44.212843 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:44.212994 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:44.316226 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:44.316444 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:44.506140 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:44.762859 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:44.763182 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:44.864928 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:44.865171 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:45.007460 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:50:45.018606 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:45.029385 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:45.057337 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:45.057337 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:45.057337 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:45.057337 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:45.057337 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:45.057337 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:45.057337 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:45.057337 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:45.057337 np0000003683 cinder-backup[101221]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:45.057337 np0000003683 cinder-backup[101221]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:45.057337 np0000003683 cinder-backup[101221]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:50:45.057337 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:45.057337 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:45.057337 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:45.057337 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:45.057337 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:50:45.058116 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:45.058116 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:45.058116 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:45.058116 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:45.058116 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:45.058116 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:45.058116 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:45.058116 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:45.058116 np0000003683 cinder-backup[101221]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:45.058116 np0000003683 cinder-backup[101221]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:45.058116 np0000003683 cinder-backup[101221]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:50:45.058116 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:45.058116 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:45.058116 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:45.058116 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:45.058116 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:50:45.083776 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:45.105453 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734, portal: 192.168.40.100,3260] Jun 26 02:50:45.105453 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734, portal: 192.168.40.100,3260] successful. Jun 26 02:50:45.105453 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:45.118757 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:45.145303 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:45.145303 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:45.145303 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:45.145303 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:45.145303 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:45.145303 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:45.145303 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:45.145303 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:45.145303 np0000003683 cinder-backup[101221]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:45.145303 np0000003683 cinder-backup[101221]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:45.145303 np0000003683 cinder-backup[101221]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:50:45.145303 np0000003683 cinder-backup[101221]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash) Jun 26 02:50:45.145303 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:45.145303 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:45.145303 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:45.145303 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:45.145303 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:50:45.145738 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:45.145738 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:45.145738 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:45.145738 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:45.145738 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:45.145738 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:45.145738 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:45.145738 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:45.145738 np0000003683 cinder-backup[101221]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:45.145738 np0000003683 cinder-backup[101221]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:45.145738 np0000003683 cinder-backup[101221]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:50:45.145738 np0000003683 cinder-backup[101221]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash) Jun 26 02:50:45.145738 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:45.145738 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:45.145738 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:45.145738 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:45.145738 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:50:45.146095 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:50:45.146179 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:50:45.148532 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] HCTL ('22', '-', '-', 0) found on session 126 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:50:45.148825 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Scanning host 22 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:50:45.161326 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Searching for a device in session 126 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:50:45.163422 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6264d4-fda5-450d-87e7-c406f1d8d734', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:50:45.345227 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:45.345410 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:45.459905 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:45.460728 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:45.659836 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:45.940119 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:45.940260 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:46.056867 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:46.057285 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:46.165677 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.194s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:50:46.165934 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] <== connect_volume: return (2194ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799084', 'path': '/dev/sdq'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:50:46.166260 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdq {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:50:46.196514 np0000003683 sudo[141585]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdq Jun 26 02:50:46.197395 np0000003683 sudo[141585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:50:46.287411 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:46.536955 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:46.537166 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:46.546378 np0000003683 sudo[141585]: pam_unix(sudo:session): session closed for user root Jun 26 02:50:46.548248 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdq" returned: 0 in 0.382s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:50:46.558061 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] _create_container started, container: tempest-volumesbackupstest-backup-container-1969770382,backup: a31b0af3-25cc-485a-9899-b476cff3fd4f. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:50:46.649132 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:46.649323 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:46.750156 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] generate_object_name_prefix: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:50:46.762657 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] starting backup of volume: e1d6f62f-72e0-42df-a20e-cf29b92618e0, volume size: 1073741824, object names prefix volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:50:46.876026 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:46.989443 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:47.139122 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:47.139424 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:47.242168 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:47.242418 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:47.263685 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:47.263881 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:47.446341 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:47.446657 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:47.497982 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:47.656744 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:47.755327 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:47.755531 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:47.863321 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:47.863553 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:47.903349 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:47.903610 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:48.031657 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:48.031899 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:48.104092 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:48.303524 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:48.361043 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:48.361242 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:48.485921 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:48.486132 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:48.567505 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:48.569057 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:48.682101 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:48.704960 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:48.705159 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:48.914871 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:48.941226 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:48.943698 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:49.047764 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:49.047938 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:49.236153 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:49.260083 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:49.260257 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:49.380464 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:49.380948 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:49.487878 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:49.488140 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:49.568663 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:49.596577 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:49.596821 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:49.805286 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:49.825329 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:49.825549 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:49.934243 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:49.934414 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:50.062627 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:50.062750 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:50.118901 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:50.161632 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:50.161810 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:50.350292 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:50.365152 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:50.365555 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:50.467123 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:50.467598 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:50.605759 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:50.605902 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:50.661642 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:50.708608 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:50.708846 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:50.911455 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:50.927102 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:50.927348 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:51.047211 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:51.047394 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:51.173191 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:51.173407 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:51.262639 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:51.310323 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:51.310528 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:51.518794 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:51.519320 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:51.523794 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:51.632919 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:51.632919 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:51.785821 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:51.786223 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:51.832492 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:51.902020 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:51.902185 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:52.102613 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:52.112064 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:52.112064 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:52.227880 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:52.228088 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:52.373750 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:52.373984 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:52.441182 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:52.496190 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:52.496373 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:52.693881 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:52.693881 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:52.696516 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:52.819234 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:52.819234 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:52.970050 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:52.970050 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:53.058892 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:53.085021 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:53.085021 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:53.329262 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:53.354660 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:53.354821 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:53.477784 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:53.477955 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:53.596248 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:53.596471 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:53.688880 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:53.702418 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:53.702904 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:53.896037 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:53.939792 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:53.939978 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:54.083345 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:54.083579 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:54.156224 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:54.156455 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:54.267520 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:54.268002 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:54.297811 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:54.389029 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:54.516136 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:54.516324 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:54.566582 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:54.566813 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:54.586095 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:54.586095 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:54.595094 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:50:54.606428 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:50:54.606604 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:50:54.610945 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:50:54.610945 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:50:54.614309 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:50:54.614593 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:50:54.672143 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:54.672433 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:54.697381 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:50:54.698348 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] _write_metadata started, container name: volumebackups, metadata filename: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:50:54.735535 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "7792e7e4-153e-4c91-b651-a76c2b10d1f7",\n "backup_name": "tempest-VolumesBackupsTest-Backup-2139423736",\n "created_at": "2026-06-26 02:50:38+00:00",\n "objects": [\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "1ccea677-9f74-4cf7-b159-cf84d9345e2e",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"1ccea677-9f74-4cf7-b159-cf84d9345e2e\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"76814a8561f64788a98990bb48923696\\", \\"project_id\\": \\"56301a4e8d3e4c228f3a24467568fd7b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:50:37.000000\\", \\"launched_at\\": \\"2026-06-26T02:50:37.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-655094110\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:50:36.000000\\", \\"updated_at\\": \\"2026-06-26T02:50:38.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:50:54.749065 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] backup 7792e7e4-153e-4c91-b651-a76c2b10d1f7 finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:50:54.892168 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:50:54.925698 np0000003683 sudo[142075]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde Jun 26 02:50:54.926381 np0000003683 sudo[142075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:50:54.954333 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:55.211188 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:55.211345 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:55.318830 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:55.319040 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:55.334433 np0000003683 sudo[142075]: pam_unix(sudo:session): session closed for user root Jun 26 02:50:55.336316 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde" returned: 0 in 0.444s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:50:55.336916 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799080', 'path': '/dev/sde'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:50:55.337122 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:50:55.337691 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:50:55.338083 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:50:55.383789 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:50:55.385423 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:50:55.385423 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:50:55.385423 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:50:55.385423 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:55.483705 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:50:55.484305 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734', '126'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:50:55.484863 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', '125')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:50:55.486180 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Resulting device map defaultdict(. at 0x79db78f40cc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e'): ({'sde'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:50:55.486515 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Removing single pathed devices sde {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:50:55.514246 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Flushing IO for device /dev/sde {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:50:55.522136 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:50:55.553512 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:55.583172 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Checking to see if SCSI volumes sde have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:50:55.583385 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] SCSI volumes sde have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:50:55.588721 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Checking to see if device paths {'sde'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:50:55.603866 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Device paths {'sde'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:50:55.603866 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:50:55.614691 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:55.670805 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 125, target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, portal: 192.168.40.100,3260] Jun 26 02:50:55.670805 np0000003683 cinder-backup[101221]: Logout of [sid: 125, target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, portal: 192.168.40.100,3260] successful. Jun 26 02:50:55.670805 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:55.693993 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:55.694293 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:50:55.694442 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] <== disconnect_volume: return (357ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:50:55.809962 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:55.810910 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:55.925379 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:55.925569 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:56.160966 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:56.411008 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:56.411227 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:56.525834 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:56.526025 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:56.741247 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-0d2462c6-26cf-423b-a6b8-7204f31f587b tempest-VolumesBackupsTest-2142713548 None] Create backup finished. backup: 7792e7e4-153e-4c91-b651-a76c2b10d1f7. Jun 26 02:50:56.761623 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:57.013854 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:57.013854 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:57.125463 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:57.125463 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:57.250897 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Create backup started, backup: 7dc3a78c-0502-4c69-8a46-5552cef8b3fc volume: 1ccea677-9f74-4cf7-b159-cf84d9345e2e. Jun 26 02:50:57.278117 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-06-26T02:50:57Z,data_timestamp=2026-06-26T02:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-793110816',encryption_key_id=None,fail_reason=None,host='np0000003683',id=7dc3a78c-0502-4c69-8a46-5552cef8b3fc,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='56301a4e8d3e4c228f3a24467568fd7b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='76814a8561f64788a98990bb48923696',volume_id=1ccea677-9f74-4cf7-b159-cf84d9345e2e) Jun 26 02:50:57.309297 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_56301a4e8d3e4c228f3a24467568fd7b {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:50:57.309623 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:50:57.310148 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:50:57.324180 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:50:57.344916 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:50:57.360329 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:50:57.360854 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:50:57.369938 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:50:57.372404 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe06:4738', 'fe80::fc16:3eff:feb5:b10f', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:fe18:269', 'fe80::fc16:3eff:fef8:d9e0', 'fe80::5008:6cff:fe61:eb31', 'fe80::fc16:3eff:fe1a:8138', 'fe80::1889:51ff:fe8e:c04c', 'fe80::fc16:3eff:fe1f:2cfe', 'fe80::fc16:3eff:fe58:ad7f', 'fe80::74de:4eff:fe49:517', 'fe80::fc16:3eff:fe13:e116'] Jun 26 02:50:57.373126 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:50:57.373347 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:50:57.373924 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] <== get_connector_properties: return (62ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:50:57.385419 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:57.630307 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:57.630617 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:57.752452 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:57.752668 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:57.793313 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:50:57.881171 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:50:57.881705 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:50:57.881943 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:50:57.882453 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:50:57.882748 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:50:57.896871 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:50:57.898277 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:50:57.898612 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:50:57.910937 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:50:57.910937 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:57.924143 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e] added Jun 26 02:50:57.924143 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:50:57.924143 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:50:57.924143 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:50:57.924143 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:50:57.924143 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:50:57.924143 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:57.924643 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:50:57.925205 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:50:57.925684 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:50:58.003130 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:58.256447 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:58.256447 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:58.374906 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:58.375111 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:58.585343 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:58.836003 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:58.836003 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:58.926420 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:50:58.939932 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:58.956059 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:58.956891 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:58.957053 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash) Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash) Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash) Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:58.980719 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash) Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash) Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash) Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:58.982020 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:50:59.043800 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, portal: 192.168.40.100,3260] Jun 26 02:50:59.043800 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, portal: 192.168.40.100,3260] successful. Jun 26 02:50:59.043800 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:59.058440 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:50:59.077417 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] HCTL ('10', '-', '-', 0) found on session 129 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:50:59.093680 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Scanning host 10 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:50:59.111926 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Searching for a device in session 129 and hctl ['10', '*', '*', 0] yield: sde {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:50:59.112947 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:50:59.218892 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:50:59.219627 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:50:59.284182 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:50:59.284182 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:50:59.292251 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:50:59.298874 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:50:59.299160 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:50:59.303388 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:50:59.303740 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:50:59.307386 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:50:59.307854 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-1969770382, sha256file filename: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:50:59.366690 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:50:59.366914 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-1969770382, metadata filename: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:50:59.394930 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "a31b0af3-25cc-485a-9899-b476cff3fd4f",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1637006421",\n "created_at": "2026-06-26 02:50:43+00:00",\n "objects": [\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "e1d6f62f-72e0-42df-a20e-cf29b92618e0",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"e1d6f62f-72e0-42df-a20e-cf29b92618e0\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"3f08f0507eec40189b858129b4cc7fd1\\", \\"project_id\\": \\"c05f689c58a04254b3930f0cc279148c\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:49:39.000000\\", \\"launched_at\\": \\"2026-06-26T02:49:39.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1574765495\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:49:38.000000\\", \\"updated_at\\": \\"2026-06-26T02:50:43.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:50:59.401588 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] backup a31b0af3-25cc-485a-9899-b476cff3fd4f finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:50:59.538979 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdq {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:50:59.565512 np0000003683 sudo[142251]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdq Jun 26 02:50:59.566604 np0000003683 sudo[142251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:50:59.906235 np0000003683 sudo[142251]: pam_unix(sudo:session): session closed for user root Jun 26 02:50:59.908159 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdq" returned: 0 in 0.369s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:50:59.908756 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6264d4-fda5-450d-87e7-c406f1d8d734', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799084', 'path': '/dev/sdq'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:50:59.908926 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:00.117959 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.235s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:00.118361 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] <== connect_volume: return (2236ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799080', 'path': '/dev/sde'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:00.118972 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:00.129023 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.219s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:00.130105 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6264d4-fda5-450d-87e7-c406f1d8d734', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:51:00.143160 np0000003683 sudo[142257]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde Jun 26 02:51:00.144056 np0000003683 sudo[142257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:51:00.149804 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:00.186905 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018 (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0 (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734 (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:00.187610 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54b441cb-7c4b-4d93-9731-7cd9bdc79018', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1d6f62f-72e0-42df-a20e-cf29b92618e0', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734', '126'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcdb2e89-1965-4d17-9c10-c1c41155586a', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:51:00.188146 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734', '126')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:51:00.191495 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Resulting device map defaultdict(. at 0x79db5abffb00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734'): ({'sdq'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:51:00.191495 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Removing single pathed devices sdq {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:51:00.203173 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Flushing IO for device /dev/sdq {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:51:00.212991 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:51:00.269415 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Checking to see if SCSI volumes sdq have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:51:00.269836 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] SCSI volumes sdq have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:51:00.273414 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Checking to see if device paths {'sdq'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:51:00.284914 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Device paths {'sdq'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:51:00.285436 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:51:00.298329 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:00.351879 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 126, target: iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734, portal: 192.168.40.100,3260] Jun 26 02:51:00.351879 np0000003683 cinder-backup[101221]: Logout of [sid: 126, target: iqn.2023-03.storpool.com:os--volume-bd6264d4-fda5-450d-87e7-c406f1d8d734, portal: 192.168.40.100,3260] successful. Jun 26 02:51:00.351879 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:00.383138 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:00.383396 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:00.383569 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] <== disconnect_volume: return (474ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:00.477872 np0000003683 sudo[142257]: pam_unix(sudo:session): session closed for user root Jun 26 02:51:00.480568 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde" returned: 0 in 0.361s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:51:00.487739 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] _create_container started, container: volumebackups,backup: 7dc3a78c-0502-4c69-8a46-5552cef8b3fc. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:51:00.535073 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] generate_object_name_prefix: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:51:00.539975 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] starting backup of volume: 1ccea677-9f74-4cf7-b159-cf84d9345e2e, volume size: 1073741824, object names prefix volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:51:00.753229 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:00.996784 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:00.996967 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:01.101668 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:01.101887 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:01.296387 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:01.416838 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-b701878b-aa38-4827-9fec-3b5efc86716b tempest-VolumesBackupsTest-1738581805 None] Create backup finished. backup: a31b0af3-25cc-485a-9899-b476cff3fd4f. Jun 26 02:51:01.559337 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:01.559337 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:01.674537 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:01.674537 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:01.800594 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] Delete backup started, backup: a31b0af3-25cc-485a-9899-b476cff3fd4f. Jun 26 02:51:01.827043 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_c05f689c58a04254b3930f0cc279148c {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:51:01.828834 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:51:01.828834 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] delete started, backup: a31b0af3-25cc-485a-9899-b476cff3fd4f, container: tempest-volumesbackupstest-backup-container-1969770382, prefix: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:51:01.895634 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] generated object list: ['volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00001', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00002', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00003', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00004', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00005', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00006', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00007', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00008', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00009', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00010', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00011', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00012', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00013', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00014', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00015', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00016', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00017', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00018', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00019', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00020', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00021', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f_metadata', 'volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:51:01.898613 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:01.924779 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00001 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:01.948504 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00002 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:01.974258 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00003 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:01.995739 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00004 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.024495 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00005 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.046304 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00006 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.068273 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00007 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.087095 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00008 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.105505 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00009 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.129785 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00010 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.150197 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:02.150197 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:02.153030 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00011 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.180940 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00012 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.208894 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00013 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.231501 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00014 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.252004 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00015 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.262676 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:02.262676 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:02.288643 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00016 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.297734 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:51:02.307826 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00017 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.334159 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00018 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.362948 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00019 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.386905 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00020 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.406637 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f-00021 in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.426327 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f_metadata in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.447350 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e1d6f62f-72e0-42df-a20e-cf29b92618e0/20260626025046/az_nova_backup_a31b0af3-25cc-485a-9899-b476cff3fd4f_sha256file in container: tempest-volumesbackupstest-backup-container-1969770382. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:02.447747 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] delete a31b0af3-25cc-485a-9899-b476cff3fd4f finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:51:02.469630 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] Created reservations ['26eaae43-3ea8-489a-b28c-fd2378419a8f', 'd4aa63b3-3560-45ba-bb9e-0168d8786a45'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:51:02.487310 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-6a10423e-6058-42b6-b361-2ad9c8f55233 tempest-VolumesBackupsTest-1738581805 None] Delete backup finished, backup a31b0af3-25cc-485a-9899-b476cff3fd4f deleted. Jun 26 02:51:02.516472 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:02.758928 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:02.758928 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:02.874074 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:02.874074 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:03.090052 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:03.352440 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:03.352440 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:03.457418 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:03.457418 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:03.669599 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:03.928422 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:03.928618 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:04.049801 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:04.049801 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:04.277723 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:04.530048 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:04.530048 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:04.631991 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:04.631991 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:04.821691 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:05.078732 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:05.078732 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:05.183609 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:05.183609 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:05.431474 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:05.692591 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:05.692591 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:05.805072 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:05.806547 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:05.984922 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:06.234345 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:06.234975 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:06.346960 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:06.346960 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:06.554178 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:06.812147 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:06.815528 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:06.925614 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:06.928538 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:07.118653 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:07.381004 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:07.381004 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:07.486604 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:07.486604 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:07.718595 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:07.978639 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:07.978639 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:08.076730 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:08.077970 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:08.261270 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:08.512198 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:08.512198 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:08.620089 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:08.620089 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:08.807750 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:09.063058 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:09.063808 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:09.198144 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:09.198277 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:09.417742 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:09.658686 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:09.658859 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:09.756335 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:09.756519 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:09.993286 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:10.257502 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:10.257502 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:10.376632 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:10.376846 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:10.592594 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:10.834637 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:10.834839 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:10.935956 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:10.936056 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:11.118551 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:11.364374 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:11.364675 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:11.474570 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:11.474777 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:11.682058 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:11.966977 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:11.967108 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:12.076887 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:12.077045 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:12.192188 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:12.311962 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:12.312331 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:12.377716 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup MD5 for volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:12.378269 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:12.387008 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:51:12.394092 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:51:12.394328 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:51:12.402695 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:51:12.403022 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:51:12.408285 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:51:12.408612 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:51:12.465967 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:51:12.466700 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] _write_metadata started, container name: volumebackups, metadata filename: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:51:12.494836 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "7dc3a78c-0502-4c69-8a46-5552cef8b3fc",\n "backup_name": "tempest-VolumesBackupsTest-Backup-793110816",\n "created_at": "2026-06-26 02:50:57+00:00",\n "objects": [\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "1ccea677-9f74-4cf7-b159-cf84d9345e2e",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"1ccea677-9f74-4cf7-b159-cf84d9345e2e\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"76814a8561f64788a98990bb48923696\\", \\"project_id\\": \\"56301a4e8d3e4c228f3a24467568fd7b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:50:37.000000\\", \\"launched_at\\": \\"2026-06-26T02:50:37.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-655094110\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:50:36.000000\\", \\"updated_at\\": \\"2026-06-26T02:50:57.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:51:12.499416 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] backup 7dc3a78c-0502-4c69-8a46-5552cef8b3fc finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:51:12.625326 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:12.644009 np0000003683 sudo[142603]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde Jun 26 02:51:12.644854 np0000003683 sudo[142603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:51:12.693486 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:51:12.694020 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:51:13.022135 np0000003683 sudo[142603]: pam_unix(sudo:session): session closed for user root Jun 26 02:51:13.024600 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde" returned: 0 in 0.399s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:51:13.024730 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799080', 'path': '/dev/sde'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:13.027678 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:13.027678 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:13.027678 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:13.038159 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:13.038997 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:51:13.038997 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:51:13.038997 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:51:13.038997 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:51:13.065160 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:13.065160 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:13.065160 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:13.065160 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:13.065160 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:13.065160 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:13.065160 np0000003683 cinder-backup[101221]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:13.065160 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:13.065160 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:13.065160 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:13.065160 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:13.065160 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:13.065624 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:13.065624 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:13.065624 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:13.065624 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:13.065624 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:13.065624 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:13.065624 np0000003683 cinder-backup[101221]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:13.065624 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:13.065624 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:13.065624 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:13.065624 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:13.065624 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:13.065624 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '118'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:51:13.065974 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', '129')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:51:13.067264 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Resulting device map defaultdict(. at 0x79db5a7ea200>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e'): ({'sde'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:51:13.067548 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Removing single pathed devices sde {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:51:13.079974 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Flushing IO for device /dev/sde {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:51:13.088882 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:51:13.145661 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Checking to see if SCSI volumes sde have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:51:13.145661 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] SCSI volumes sde have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:51:13.146249 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Checking to see if device paths {'sde'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:51:13.160230 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Device paths {'sde'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:51:13.160230 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:51:13.169524 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:13.211514 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 129, target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, portal: 192.168.40.100,3260] Jun 26 02:51:13.211514 np0000003683 cinder-backup[101221]: Logout of [sid: 129, target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, portal: 192.168.40.100,3260] successful. Jun 26 02:51:13.211514 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:13.227343 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:13.227582 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.202s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:13.227722 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] <== disconnect_volume: return (203ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:14.248898 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-ce858922-52ee-45f8-8dd1-2eaef2dbd2cf tempest-VolumesBackupsTest-665014974 None] Create backup finished. backup: 7dc3a78c-0502-4c69-8a46-5552cef8b3fc. Jun 26 02:51:14.773738 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Create backup started, backup: de3bd523-0811-41c0-8f27-51766a270512 volume: 1ccea677-9f74-4cf7-b159-cf84d9345e2e. Jun 26 02:51:14.780145 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-06-26T02:51:14Z,data_timestamp=2026-06-26T02:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-68770066',encryption_key_id=None,fail_reason=None,host='np0000003683',id=de3bd523-0811-41c0-8f27-51766a270512,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(7792e7e4-153e-4c91-b651-a76c2b10d1f7),parent_id='7792e7e4-153e-4c91-b651-a76c2b10d1f7',project_id='ec9765c5e68d4391876fe64b00b50ea0',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='7c2cdba6cd9c40a4a9c4aae763ca1711',volume_id=1ccea677-9f74-4cf7-b159-cf84d9345e2e) Jun 26 02:51:14.814955 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_ec9765c5e68d4391876fe64b00b50ea0 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:51:14.814955 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:51:14.816263 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:14.830370 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:51:14.850075 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:14.861808 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:51:14.862428 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:51:14.868735 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:51:14.869958 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe06:4738', 'fe80::fc16:3eff:fef8:d9e0', 'fe80::5008:6cff:fe61:eb31', 'fe80::fc16:3eff:fe1f:2cfe', 'fe80::fc16:3eff:fe58:ad7f', 'fe80::74de:4eff:fe49:517'] Jun 26 02:51:14.870086 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:51:14.870354 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:51:14.870433 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:15.374215 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:51:15.374689 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:15.374869 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:15.375393 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:15.375666 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:51:15.387048 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:15.387451 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:15.387692 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:51:15.398430 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:51:15.398430 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:15.408828 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e] added Jun 26 02:51:15.408828 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:51:15.408828 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:51:15.408828 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:51:15.408828 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:51:15.408828 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:51:15.408828 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:15.409091 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:51:15.409494 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0217(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:51:15.409816 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:51:16.410763 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:51:16.422421 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:16.433021 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:16.450698 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:16.450698 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:16.450698 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:16.450698 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:16.450698 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:16.450698 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:16.450698 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:16.450698 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:16.450698 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:16.450698 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:16.450698 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:16.451115 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:16.451115 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:16.451115 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:16.451115 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:16.451115 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:16.451115 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:16.451115 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:16.451115 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:16.451115 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:16.451115 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:16.451115 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:16.502043 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, portal: 192.168.40.100,3260] Jun 26 02:51:16.502043 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, portal: 192.168.40.100,3260] successful. Jun 26 02:51:16.502043 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:16.513858 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:16.532702 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:16.532702 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:16.532702 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:16.532702 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:16.532702 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:16.532702 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:16.532702 np0000003683 cinder-backup[101221]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:16.532702 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:16.532702 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:16.532702 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:16.532702 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:16.532702 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:16.533612 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:16.533612 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:16.533612 np0000003683 cinder-backup[101221]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:16.533612 np0000003683 cinder-backup[101221]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:16.533612 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:16.533612 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:16.533612 np0000003683 cinder-backup[101221]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:16.533612 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:16.533612 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:16.533612 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:16.533612 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:16.533612 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:16.534019 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:16.534149 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:51:16.535267 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] HCTL ('7', '-', '-', 0) found on session 130 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:51:16.535414 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:51:16.550055 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Searching for a device in session 130 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:51:16.550261 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:51:17.553705 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.178s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:17.554095 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] <== connect_volume: return (2179ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799080', 'path': '/dev/sdb'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:17.554158 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:17.572389 np0000003683 sudo[142876]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jun 26 02:51:17.573012 np0000003683 sudo[142876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:51:17.931130 np0000003683 sudo[142876]: pam_unix(sudo:session): session closed for user root Jun 26 02:51:17.933790 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.379s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:51:17.982714 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:51:17.995362 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7_sha256file. {{(pid=101221) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jun 26 02:51:18.048749 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] _read_sha256file finished. {{(pid=101221) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jun 26 02:51:18.088258 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Create backup started, backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9 volume: e876102a-9311-44e0-a8aa-8128f39b45ec. Jun 26 02:51:18.094320 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-859090827',created_at=2026-06-26T02:51:17Z,data_timestamp=2026-06-26T02:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-225240867',encryption_key_id=None,fail_reason=None,host='np0000003683',id=7addc0a1-2cd8-4ab2-9778-17721e2a28e9,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c05f689c58a04254b3930f0cc279148c',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3f08f0507eec40189b858129b4cc7fd1',volume_id=e876102a-9311-44e0-a8aa-8128f39b45ec) Jun 26 02:51:18.097755 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] _create_container started, container: volumebackups,backup: de3bd523-0811-41c0-8f27-51766a270512. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:51:18.119244 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_c05f689c58a04254b3930f0cc279148c {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:51:18.119456 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:51:18.119805 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:18.121567 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] generate_object_name_prefix: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025118/az_nova_backup_de3bd523-0811-41c0-8f27-51766a270512 {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:51:18.154723 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:51:18.157243 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:51:18.160887 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] starting backup of volume: 1ccea677-9f74-4cf7-b159-cf84d9345e2e, volume size: 1073741824, object names prefix volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025118/az_nova_backup_de3bd523-0811-41c0-8f27-51766a270512, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:51:18.174912 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:18.193017 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:51:18.193235 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:51:18.205741 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:51:18.207044 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fea6:edf4', 'fe80::fc16:3eff:fe06:4738', 'fe80::fc16:3eff:fe1f:2cfe', 'fe80::fc16:3eff:fe58:ad7f', 'fe80::74de:4eff:fe49:517'] Jun 26 02:51:18.207233 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:51:18.207322 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:51:18.207654 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:18.711172 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:51:18.712032 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e876102a-9311-44e0-a8aa-8128f39b45ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:18.712032 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:18.712549 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:18.712802 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e876102a-9311-44e0-a8aa-8128f39b45ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:51:18.729131 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:18.729686 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:18.730090 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:51:18.744473 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:51:18.744473 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:18.756348 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec] added Jun 26 02:51:18.756348 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:51:18.756348 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:51:18.756348 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:51:18.756348 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:51:18.756348 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:51:18.756348 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:18.756704 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:51:18.757143 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:51:18.757374 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:51:19.758372 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:51:19.769991 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:19.782050 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:19.803363 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:19.803363 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:19.803363 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:19.803363 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:19.803363 np0000003683 cinder-backup[101221]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:19.803363 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:19.803363 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:19.803363 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:19.803363 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:19.803363 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:19.803795 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:19.803795 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:19.803795 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:19.803795 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:19.803795 np0000003683 cinder-backup[101221]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:19.803795 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:19.803795 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:19.803795 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:19.803795 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:19.803795 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:19.865310 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec, portal: 192.168.40.100,3260] Jun 26 02:51:19.865310 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec, portal: 192.168.40.100,3260] successful. Jun 26 02:51:19.865310 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:19.880747 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:19.903189 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:51:19.904314 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] HCTL ('8', '-', '-', 0) found on session 131 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:51:19.904525 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Scanning host 8 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:51:19.939001 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Searching for a device in session 131 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:51:19.939591 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e876102a-9311-44e0-a8aa-8128f39b45ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:51:20.945048 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.232s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:20.945659 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] <== connect_volume: return (2233ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799088', 'path': '/dev/sdc'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:20.945659 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:20.970381 np0000003683 sudo[143053]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc Jun 26 02:51:20.971096 np0000003683 sudo[143053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:51:21.046220 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Create backup started, backup: 062f5886-9ca3-4c9a-a1cd-3743554c42fb volume: a5fbcabf-ce3a-4fad-9b90-c7b9003301d0. Jun 26 02:51:21.053612 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-06-26T02:51:20Z,data_timestamp=2026-06-26T02:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-652998502',encryption_key_id=None,fail_reason=None,host='np0000003683',id=062f5886-9ca3-4c9a-a1cd-3743554c42fb,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(5464cf72-b70d-4129-ba1b-1c34c4c31aae),parent_id='5464cf72-b70d-4129-ba1b-1c34c4c31aae',project_id='7a0a7fdd73fc40328c4c73ef53edc697',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='6abcc90720de4d3e8d49aa5c4bb02b11',volume_id=a5fbcabf-ce3a-4fad-9b90-c7b9003301d0) Jun 26 02:51:21.085842 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_7a0a7fdd73fc40328c4c73ef53edc697 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:51:21.086094 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:51:21.086521 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:21.099686 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:51:21.147873 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:21.165652 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:51:21.166253 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:51:21.176025 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:51:21.178023 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fe06:4738', 'fe80::fc16:3eff:fe1f:2cfe', 'fe80::fc16:3eff:fe58:ad7f', 'fe80::74de:4eff:fe49:517'] Jun 26 02:51:21.178620 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:51:21.178853 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:51:21.179315 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:21.249717 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:51:21.316764 np0000003683 sudo[143053]: pam_unix(sudo:session): session closed for user root Jun 26 02:51:21.319192 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc" returned: 0 in 0.373s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:51:21.328502 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] _create_container started, container: tempest-volumesbackupstest-backup-container-859090827,backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:51:21.396733 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] generate_object_name_prefix: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9 {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:51:21.410017 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] starting backup of volume: e876102a-9311-44e0-a8aa-8128f39b45ec, volume size: 1073741824, object names prefix volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:51:21.686749 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:51:21.687155 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:21.687340 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:21.687829 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:21.688047 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:51:21.723269 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:21.723269 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:21.723269 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:51:21.751776 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:51:21.751776 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:21.765257 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0] added Jun 26 02:51:21.765257 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:51:21.765257 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:51:21.765257 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:51:21.765257 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:51:21.765257 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:51:21.765257 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:21.765630 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:51:21.766350 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0433(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:51:21.766731 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:51:21.784302 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:22.265374 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=154,cinder:UPDATE=39,cinder:INSERT=4 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:51:22.556068 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 19825286 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:22.556299 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:22.767533 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:51:22.782723 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:22.796759 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:22.813428 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:22.813428 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:22.813428 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:22.813428 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:22.813428 np0000003683 cinder-backup[101221]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:22.813428 np0000003683 cinder-backup[101221]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:22.813428 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:22.813428 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:22.813428 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:22.813428 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:22.813428 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:22.813785 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:22.813785 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:22.813785 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:22.813785 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:22.813785 np0000003683 cinder-backup[101221]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:22.813785 np0000003683 cinder-backup[101221]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:22.813785 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:22.813785 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:22.813785 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:22.813785 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:22.813785 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:22.867970 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, portal: 192.168.40.100,3260] Jun 26 02:51:22.867970 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, portal: 192.168.40.100,3260] successful. Jun 26 02:51:22.867970 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] HCTL ('9', '-', '-', 0) found on session 132 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Searching for a device in session 132 and hctl ['9', '*', '*', 0] yield: None {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00001: 82571f7121cb9475563edde615e4e4df {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025118/az_nova_backup_de3bd523-0811-41c0-8f27-51766a270512_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] _write_metadata started, container name: volumebackups, metadata filename: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025118/az_nova_backup_de3bd523-0811-41c0-8f27-51766a270512_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "de3bd523-0811-41c0-8f27-51766a270512",\n "backup_name": "tempest-VolumesBackupsTest-Backup-68770066",\n "created_at": "2026-06-26 02:51:15+00:00",\n "objects": [],\n "parent_id": "7792e7e4-153e-4c91-b651-a76c2b10d1f7",\n "version": "1.0.0",\n "volume_id": "1ccea677-9f74-4cf7-b159-cf84d9345e2e",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"1ccea677-9f74-4cf7-b159-cf84d9345e2e\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"76814a8561f64788a98990bb48923696\\", \\"project_id\\": \\"56301a4e8d3e4c228f3a24467568fd7b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:50:37.000000\\", \\"launched_at\\": \\"2026-06-26T02:50:37.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-655094110\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:50:36.000000\\", \\"updated_at\\": \\"2026-06-26T02:51:15.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] backup de3bd523-0811-41c0-8f27-51766a270512 finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:23.513061 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:23.598799 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:23.598799 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:23.356539 np0000003683 sudo[143274]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jun 26 02:51:23.357317 np0000003683 sudo[143274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:51:23.720891 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.390s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:51:23.720891 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799080', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:23.720891 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:23.726132 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:23.726132 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:23.715604 np0000003683 sudo[143274]: pam_unix(sudo:session): session closed for user root Jun 26 02:51:23.937362 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Searching for a device in session 132 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:51:23.937834 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:51:23.939006 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.251s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:23.942875 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] <== connect_volume: return (2255ms) {'type': 'block', 'scsi_wwn': '330000000c7f4e315', 'path': '/dev/sdd'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:23.943383 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:23.958496 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.237s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:23.959500 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:51:23.971850 np0000003683 sudo[143330]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jun 26 02:51:23.972426 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:23.972575 np0000003683 sudo[143330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:23.975375 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:23.976239 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:51:23.976239 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:51:23.976239 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:51:23.976239 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5013b4c0-b1f8-4e71-af85-cf8a7047cd85', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:51:24.013239 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', '130')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:51:24.015612 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Resulting device map defaultdict(. at 0x79db5ab7d440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e'): ({'sdb'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:51:24.015612 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Removing single pathed devices sdb {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:51:24.026107 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Flushing IO for device /dev/sdb {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:51:24.034224 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:51:24.094246 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:51:24.094415 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] SCSI volumes sdb have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:51:24.096421 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:51:24.109646 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:51:24.109870 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:51:24.122570 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:24.158705 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 130, target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, portal: 192.168.40.100,3260] Jun 26 02:51:24.158705 np0000003683 cinder-backup[101221]: Logout of [sid: 130, target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, portal: 192.168.40.100,3260] successful. Jun 26 02:51:24.158705 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:24.181697 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:24.182014 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.225s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:24.182223 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] <== disconnect_volume: return (461ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:24.282871 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 1362154 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:24.283117 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:24.347806 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.403s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:51:24.344662 np0000003683 sudo[143330]: pam_unix(sudo:session): session closed for user root Jun 26 02:51:24.357932 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae_sha256file. {{(pid=101221) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jun 26 02:51:24.426959 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] _read_sha256file finished. {{(pid=101221) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jun 26 02:51:24.429598 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00003: a35891500449df17e893f84bd88472fb {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:24.429944 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:24.463085 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] _create_container started, container: volumebackups,backup: 062f5886-9ca3-4c9a-a1cd-3743554c42fb. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:51:24.485692 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] generate_object_name_prefix: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:51:24.490097 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] starting backup of volume: a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, volume size: 1073741824, object names prefix volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:51:24.737410 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:24.780872 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:24.781795 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 639 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:24.781968 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:24.823734 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00001: 7455b0146d203e0450dd14035351df50 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:24.823734 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:24.825058 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:24.831853 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 294912 bytes of data to 27456 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:24.831853 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:24.865390 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00002: bf10bad2c2f7cac677c071e7fc3cd4f8 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:24.865577 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:24.867381 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:24.901038 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 2260992 bytes of data to 119759 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:24.901457 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:24.929568 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00003: 5951aaff2a4cd21fe8d2369f620cad44 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:24.929568 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:24.929568 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:24.931676 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 98304 bytes of data to 3974 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:24.931851 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:24.964300 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00004: e1554f9208060479cb8c0e2b20ce3092 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:24.964496 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:24.965052 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:24.970600 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 360448 bytes of data to 34483 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:24.970796 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:24.996992 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00005: 260e04b2b4be4a8fb9af5bcaeef77f5e {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:24.997187 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:24.997766 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:24.998254 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:24.998393 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.002695 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 262144 bytes of data to 36108 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.002695 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.036217 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00006: 7e4882497657c646c554c5ad835c0cf5 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.036373 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.036614 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.038563 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 279 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.038675 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.078377 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00007: 00b51f0b7326fd750bdff6f26937507f {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.081501 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.081501 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.107958 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 524288 bytes of data to 272747 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.107958 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.114667 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.114667 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.153911 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00008: 2b4dd274f6d67639fece6f6ec106817b {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.154168 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.154668 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.157676 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 98304 bytes of data to 18814 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.157892 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.196840 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00009: 807f8f1c74646a8f9592027f16d2643d {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.197005 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.197264 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.203818 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 21396 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.204095 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.235618 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-40083da7-02a9-4386-a05c-a00088224d24 tempest-VolumesBackupsTest-2142713548 None] Create backup finished. backup: de3bd523-0811-41c0-8f27-51766a270512. Jun 26 02:51:25.237931 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00010: 035de9616151b09d26063aaf3786be98 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.238057 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.238710 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.254924 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 327680 bytes of data to 158643 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.255087 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.281578 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00011: f941eba3270410ec15b7aff819b8b0c0 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.281814 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.282507 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.300519 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 327680 bytes of data to 62614 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.300715 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.329209 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00012: ba683c210943a225502816568e3b8d00 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.329352 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.330695 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.332813 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 14711 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.332959 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.346132 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.363232 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00013: e88548713f69de90eef0cd6c4e9796dd {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.363401 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.363898 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.383799 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 393216 bytes of data to 90143 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.383958 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.416675 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00014: 01e3e2d3510c4223690a6849e71496ab {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.416830 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.417255 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.421530 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 131072 bytes of data to 34865 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.421752 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.449137 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00015: 599805a91aa71f961c3787a61e7c5729 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.449322 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.449656 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.452736 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 7444 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.452895 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.490972 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00016: 179b961161bdaa477c7c01ad80585eee {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.491187 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.491515 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.505036 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 131072 bytes of data to 83926 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.505036 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.539614 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00017: d27aa048e7ec9b4cbc6afc435ead70f6 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.539773 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.540496 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.571727 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 786432 bytes of data to 349723 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.571923 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.595933 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.596180 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.599470 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00018: 93a49a74b3f385db27466765f9e213d9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.599648 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.600140 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.604459 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 30511 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.604657 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.634286 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00019: fb0b4c9f443eae7a19740e071a10002c {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.634517 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.637978 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.720594 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.720594 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.732026 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 2293760 bytes of data to 749832 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.732217 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.772105 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00020: 561fc7e20667dfc9156b44fb725f7a41 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.772974 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.777359 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.802352 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 262144 bytes of data to 60945 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.803027 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.831838 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00021: 600a0ec270d9626014f041f394a91dec {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.832102 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.833360 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.837335 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 21497 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.837575 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.866444 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00022: d74672ad69032d6511c7f86b7b0cdb23 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.867267 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.868266 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.873522 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 98304 bytes of data to 16500 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.874202 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.907335 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00023: b26d859ed07de20dd16d0c165a4e6a3a {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.907776 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.908468 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.918629 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 294912 bytes of data to 60530 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.918776 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.939166 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.949759 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00024: 17812a659c805b2d08ad0ffbac17f523 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.949920 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.952495 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.964603 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 18150 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.964603 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:25.997074 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00025: 900ba3be5febaa4a7e8d4fe06a9e5bbe {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:25.997216 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:25.997397 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:25.998648 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 5224 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:25.998765 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.019846 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00026: 7b83ad270600f54dc0ce5f973398f4a1 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.019976 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.020159 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.021550 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 7895 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.021687 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.043450 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00027: a31179c9f17d2086e474bbff2d8b9fa5 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.043450 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.043450 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.045988 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 98304 bytes of data to 16089 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.046155 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.072287 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00028: 86d6719d73ca0214c25634aedc7fe9d9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.072456 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.072695 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.076606 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 98304 bytes of data to 19002 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.076771 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.109318 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00029: fdf44fcafc023cb46fe41182b8e073b8 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.109504 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.110451 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.135735 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 524288 bytes of data to 110895 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.135902 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.160760 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00030: 5815c96da9bc9be47f2dde7f69ddd130 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.164510 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.164510 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.171358 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 131072 bytes of data to 37108 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.171541 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.207212 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.207378 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.208691 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00031: 7ecd5b62ea9a77dd27d5058cc0b2af3a {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.208691 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.208838 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.222263 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 294912 bytes of data to 57886 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.222371 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.226485 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Create backup started, backup: 7698cfa4-5084-4b6d-a933-fc2f2426bc0b volume: 1ccea677-9f74-4cf7-b159-cf84d9345e2e. Jun 26 02:51:26.235713 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-06-26T02:51:26Z,data_timestamp=2026-06-26T02:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1545465442',encryption_key_id=None,fail_reason=None,host='np0000003683',id=7698cfa4-5084-4b6d-a933-fc2f2426bc0b,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(7dc3a78c-0502-4c69-8a46-5552cef8b3fc),parent_id='7dc3a78c-0502-4c69-8a46-5552cef8b3fc',project_id='56301a4e8d3e4c228f3a24467568fd7b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='76814a8561f64788a98990bb48923696',volume_id=1ccea677-9f74-4cf7-b159-cf84d9345e2e) Jun 26 02:51:26.254169 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00032: 185eea5b60ee84638ea2ef67b051e400 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.254355 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.267399 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.269657 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 6526 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.270950 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.276693 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_56301a4e8d3e4c228f3a24467568fd7b {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:51:26.276982 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:51:26.277361 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:26.294209 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:51:26.304382 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00033: e41a77e44d240ad8104d5fb9712151e4 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.304382 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.304382 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.307073 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 14907 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.307372 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.313505 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:26.326963 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.328208 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.376983 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:51:26.377894 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:51:26.381129 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00034: a7a0eee90ff873fe50f294cf33e7de2d {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.381354 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.381762 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:51:26.382341 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.388980 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 32515 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.389340 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.389715 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:51:26.391130 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe29:6609', 'fe80::fc16:3eff:fe2f:6bc0', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fe06:4738', 'fe80::fc16:3eff:fe58:ad7f', 'fe80::74de:4eff:fe49:517', 'fe80::fc16:3eff:feb2:e492', 'fe80::48b9:b9ff:feb0:fb3a'] Jun 26 02:51:26.391458 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:51:26.391675 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:51:26.392097 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:26.428022 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00035: 5a96fd0be63a553958c90d4a4316c4de {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.428212 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.428442 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.431713 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 98304 bytes of data to 13305 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.431869 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.461359 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00036: b02b4173598f30151430937bc55a6faf {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.461562 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.462032 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.474936 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 262144 bytes of data to 90046 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.475164 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.520666 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00037: b7e2d07e021e740544325541d67b7329 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.520825 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.521066 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.522007 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 2818 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.522187 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.547570 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00038: 00fb2cc13328ca425a2eca1e6c7c4e6d {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.547570 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.547914 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.549536 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 5756 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.549752 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.579233 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00039: d11036511ad7f5dbe776a742c58f87ea {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.579429 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.579700 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.580586 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 1906 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.580770 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.622272 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00040: c4ed5bf65e3847ac3a3103aeb9f043f9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.622272 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.622272 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.623849 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.624060 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 6858 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.624225 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.657741 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00041: 2abba25a77ee36c58131400ef11e9b33 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.657741 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.657741 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.659886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 15768 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.659988 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.692928 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00042: 58c33934aea3dc04d999003f5971d3e1 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.692928 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.692928 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.694754 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 10944 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.694966 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.717053 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00043: 90971d6560092661366d4a8e0d690316 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.717303 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.717657 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.719131 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 5153 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.719422 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.744622 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00044: 6d63cabe5cbd45d0e7748b702fb3237f {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.744815 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.745254 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.753836 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 229376 bytes of data to 56731 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.754049 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.778096 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00045: b63363b73e33269b13a4b9007772caea {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:26.778528 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:26.888253 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.888503 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:26.896743 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:51:26.897559 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:26.897854 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:26.898150 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:26.898408 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:51:26.912920 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:26.913445 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:26.913777 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:51:26.926179 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:51:26.926179 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:26.937968 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e] added Jun 26 02:51:26.937968 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:51:26.937968 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:51:26.937968 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:51:26.937968 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:51:26.937968 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:51:26.937968 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:26.938369 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:51:26.938711 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0248(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:51:26.938928 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:51:26.992352 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:26.994247 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 6383 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:26.994471 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.003019 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.003213 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.020206 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00046: 7ad27b3399ebe8e17313a1edd45d2a4c {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.020413 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.020676 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.024692 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 29648 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.024875 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.062352 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00047: b2f4bed0ea8034625ddd32034addd197 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.062563 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.062811 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.074363 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 11536 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.074630 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.107725 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00048: e2ae44a38272f3786b389fe25de025f7 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.107898 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.108146 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.117048 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 131072 bytes of data to 60908 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.117276 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.148574 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00049: 459edd959d71fc76632140b2c1c2afd7 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.148772 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.149693 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.159370 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 262144 bytes of data to 49816 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.159695 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.203560 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00050: 9f03bd9a5f1f3681ce923853068a5391 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.203806 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.204342 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.207636 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 3271 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.207855 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.230207 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.253164 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00051: 808b8e5ae0ebfa3ebee1f25e56d7380e {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.253653 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.256166 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.353196 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 2162688 bytes of data to 713033 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.353196 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.399852 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00052: 9c92fcd1cade265364aca0fbf2615bff {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.399852 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.399852 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.405843 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 131072 bytes of data to 49711 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.406183 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.443613 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00053: ac2c3b7f365746cfcedfa3644641f133 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.443613 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.443613 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.458368 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 262144 bytes of data to 109962 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.458368 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.487535 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00054: d4e16afa8ee08db846e947df5b4ec08b {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.488076 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.488459 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.496393 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.496393 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.508081 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 196608 bytes of data to 106450 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.508081 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.537309 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00055: 86d6f3eb5f3f66b3bd977ec8c039a49c {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.537309 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.537309 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.544508 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 196608 bytes of data to 59932 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.544508 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.575613 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00056: 933534e51561c890b382aa9eb4c5764c {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.575613 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.575952 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.577783 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 9062 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.577783 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.602034 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.602034 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.605726 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00057: 0f7cdc5b89fbb7316ab86f111715879e {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.606053 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.606659 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.610317 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 23335 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.610679 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.640982 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00058: b3534e7bd21436d93d6e15ceae51ecbb {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.640982 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.640982 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.646701 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 36991 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.646701 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.676120 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00059: 308e5172c7191c405029e68eb339b63e {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.676120 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.676120 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.679806 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 98304 bytes of data to 27296 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.679806 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.713075 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00060: 87fed698449bb429c84cea142b47074f {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.714212 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.714645 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.719694 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 6577 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.719694 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.748024 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00061: 8577057e39906809834d6bbe62984d84 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.748024 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.748024 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.808680 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.859274 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 2162688 bytes of data to 835720 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.859441 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.902580 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00062: 286f32389d41ccb3a7454011b7fe833b {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.902580 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.902580 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.909659 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 131072 bytes of data to 32835 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.909659 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.936696 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00063: 07f83a91f2a65593c97ccde75e2cdb1a {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.936696 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.936696 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.936696 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 258 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.936696 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.939804 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:51:27.952236 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:27.964330 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00064: 472694eb9fd935b65a675e05db84ae55 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:27.964330 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:27.964330 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:27.965733 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:27.972598 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 163840 bytes of data to 60928 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:27.972598 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:27.982932 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:28.001108 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00065: 7bbd91225a7ad728f1ee251495d662a3 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.002282 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.002282 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.012674 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 196608 bytes of data to 89811 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.012674 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.028337 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, portal: 192.168.40.100,3260] Jun 26 02:51:28.028337 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, portal: 192.168.40.100,3260] successful. Jun 26 02:51:28.028337 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:28.037324 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00066: 9c2c443a510acae20e828ca784ea0ef0 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.037324 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.037324 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.039426 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 10326 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.039426 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.041164 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:28.059920 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:28.059920 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:28.059920 np0000003683 cinder-backup[101221]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:28.059920 np0000003683 cinder-backup[101221]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:28.059920 np0000003683 cinder-backup[101221]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:28.059920 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:28.059920 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:28.059920 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:28.059920 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:28.059920 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:28.060227 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:28.060227 np0000003683 cinder-backup[101221]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-555c825b-3548-4ec8-8930-0d78ce99c578 (non-flash) Jun 26 02:51:28.060227 np0000003683 cinder-backup[101221]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:28.060227 np0000003683 cinder-backup[101221]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:28.060227 np0000003683 cinder-backup[101221]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:28.060227 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:28.060227 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:28.060227 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:28.060227 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:28.060227 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:28.060405 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:28.060459 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:51:28.061385 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] HCTL ('7', '-', '-', 0) found on session 133 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:51:28.062272 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:51:28.066197 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00067: f15596026d78fb5a6c33e31e645c1bc0 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.066415 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.066661 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.071705 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 131072 bytes of data to 31811 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.071843 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.078782 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Searching for a device in session 133 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:51:28.079162 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:51:28.096353 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.096353 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.101854 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00068: 01e07b6ff49d49600cff2b5f037b5585 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.102026 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.102486 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.114524 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 196608 bytes of data to 99152 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.116116 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.155555 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00069: 2cc1e5bb8b0f7f6b8f396071b242c82d {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.155769 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.158703 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.229328 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.229578 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.282902 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 2555904 bytes of data to 1042244 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.283135 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.337041 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00070: 77a339075c2c22a3b220b8be3eafd00a {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.337041 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.338211 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.349249 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 196608 bytes of data to 64453 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.349419 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.396543 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00071: 4976e1dea54e67ed34a48147acf51f95 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.396817 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.397080 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.402976 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 7823 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.403127 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.435726 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00072: c5102cf8b89d0646b4a8454aa2eb455b {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.435964 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.436376 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.449489 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 262144 bytes of data to 50703 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.449701 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.453703 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.481667 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00073: a90b39452df564cdaee1875cdf14648d {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.481872 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.482414 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.493857 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 196608 bytes of data to 94089 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.493991 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.525730 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00074: 93190166bf0c7415bc69f707aeecba3d {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.525897 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.526813 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.562825 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 753664 bytes of data to 382335 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.562974 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.605503 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00075: f20b7ef7942c255d34567ef7a8c931d5 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.605717 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.606998 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.688150 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 1245184 bytes of data to 692194 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.688307 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.710943 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.711133 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.721450 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00076: 2fec27600c3cba1475524f3a83a147d9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.721755 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.722744 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.735125 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 229376 bytes of data to 86155 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.735382 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.767920 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00077: bd18e2aa13a8966c7ccaeb4a8d2ad111 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.768128 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.768604 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.781416 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 196608 bytes of data to 89989 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.781673 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.812877 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00078: 2742a11d6ef6f40794ba3a77fdd91fc1 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.813374 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.814400 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.827356 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.827608 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.856763 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 753664 bytes of data to 244005 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.857001 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.891404 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00079: 937919e06f1ac884e907b3b44f7aa3f7 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.891659 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.892085 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.893755 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 8385 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.893925 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.926303 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00080: 80bf1a781b69ed6d28f051a8c1bace93 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.926524 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.926738 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.932143 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 98304 bytes of data to 35069 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.932701 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:28.960712 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00081: 839ea305330c068b1e25e10bbe0072eb {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:28.960892 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:28.961359 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:28.997132 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 196608 bytes of data to 101460 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:28.997288 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.028387 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.044207 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00082: e35f12e70225bea64f1d64820a8c34af {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.044437 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.044774 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.046689 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 27789 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.047005 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.078934 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00083: b64ba69a7c7b92cbb6e034a227c535e1 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.079125 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.079543 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.085323 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.187s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:29.085611 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] <== connect_volume: return (2187ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799080', 'path': '/dev/sdb'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:29.085985 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:29.100636 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 163840 bytes of data to 57870 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.100970 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.111220 np0000003683 sudo[143521]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jun 26 02:51:29.112093 np0000003683 sudo[143521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:51:29.134419 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00084: 7271b184b3a0862c0307275252dd4c26 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.134803 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.135324 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.149863 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 196608 bytes of data to 111151 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.150120 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.179590 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00085: 534ab1b26cf91adf3fcf3f10f1b565b6 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.179855 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.180674 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.198113 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 524288 bytes of data to 186703 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.198113 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.228871 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00086: 7b93fd040fdb51b64825f978837710a0 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.229112 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.229624 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.233825 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 98304 bytes of data to 3525 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.233979 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.272216 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00087: 37d447129a7727064c85371ab726a3d9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.272426 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.272793 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.274494 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 758 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.274494 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.300866 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00088: 69d1884fb24558398ae7f36ef9ba922e {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.301044 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.301290 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.303544 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.303730 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.312471 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 262144 bytes of data to 93620 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.312471 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.338609 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00089: a77c3df81950fe3ec6756b32c47d5889 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.338772 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.419859 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.419964 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.489403 np0000003683 sudo[143521]: pam_unix(sudo:session): session closed for user root Jun 26 02:51:29.491383 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.405s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:51:29.495915 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc_sha256file. {{(pid=101221) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jun 26 02:51:29.531568 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] _read_sha256file finished. {{(pid=101221) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jun 26 02:51:29.539104 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] _create_container started, container: volumebackups,backup: 7698cfa4-5084-4b6d-a933-fc2f2426bc0b. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:51:29.570774 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] generate_object_name_prefix: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025129/az_nova_backup_7698cfa4-5084-4b6d-a933-fc2f2426bc0b {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:51:29.577185 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] starting backup of volume: 1ccea677-9f74-4cf7-b159-cf84d9345e2e, volume size: 1073741824, object names prefix volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025129/az_nova_backup_7698cfa4-5084-4b6d-a933-fc2f2426bc0b, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:51:29.606402 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.609354 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 14202 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.610054 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.636422 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00090: c15a2e2eb7fb41df1e140bbf87c78a9c {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.636626 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.636963 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.657083 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 196608 bytes of data to 99711 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.657083 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.687072 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00091: d2f8fd157e57c49a2e7fbb7db668bdfa {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.687293 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.687699 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.692126 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 24816 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.692987 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.696122 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.724827 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00092: ab4c3c6565d120e31d0ec092b1f40fc0 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.725111 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.725795 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.727982 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 9379 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.728134 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.762805 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00093: 6df3fb11329fda670b6a648b803a75c3 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.763237 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.763237 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.765507 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 11742 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.765608 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.791532 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00094: d3338725ce0b00d0d0a20c3dc76363b5 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.791757 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.792506 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.818882 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 557056 bytes of data to 231400 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.819244 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.862945 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00095: 736df86bae8f6a9fbe7631cf877d988c {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.863081 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.863757 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.871156 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 131072 bytes of data to 45214 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.871156 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.904990 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00096: 5465c211d4134a5c770e5e96d9420f8b {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.904990 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.904990 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.906555 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 3791 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.907242 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.934781 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00097: 125fb29df3a88ed91bb536861e7d1ff9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.934843 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.935578 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.939725 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 98304 bytes of data to 26004 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.939725 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.959349 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.959557 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:29.971051 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00098: 38a20f8b3afb8be4ea4deab5f9b3d080 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:29.971305 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:29.971594 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:29.977154 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 131072 bytes of data to 34863 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:29.977337 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:30.008135 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00099: f87eeae8e3222a88fc335a905cc595f5 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:30.008316 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:30.008617 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:30.014189 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 131072 bytes of data to 28914 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:30.014395 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:30.038053 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00100: a34ec244a0a06a62255379762d3da663 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:30.038256 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:30.038881 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:30.071165 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 393216 bytes of data to 206685 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:30.071165 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:30.107607 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00101: ce40a8df09b1374e7997af78065811c8 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:30.107607 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:30.107607 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:30.108669 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 9850 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:30.108823 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:30.115631 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:30.116731 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:30.148282 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00102: 5649b75a126d07b66d0cec64e48b81cf {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:30.148282 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:30.148282 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:30.149686 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 426 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:30.149814 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:30.182420 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00103: b774092da94395745bdde14d566359fd {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:30.182663 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:30.492628 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:30.752044 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:30.752299 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:30.862154 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:30.862699 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:31.238930 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:31.279993 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:31.281284 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 68 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:31.281875 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:31.311802 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00104: 0ac8838eee7696114147d95e0878e3b2 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:31.311802 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:31.498893 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:31.500065 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:31.599605 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:31.599776 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:31.964621 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:32.003821 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:32.005720 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 426 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:32.005853 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:32.032396 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00105: bd4124b1385706f9ca588341db581eee {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:32.032678 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:32.498300 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:32.498540 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:32.607656 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:32.607857 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:32.973594 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:32.974446 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 68 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:32.974635 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:32.980207 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:33.004855 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00106: 0ac8838eee7696114147d95e0878e3b2 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:33.004980 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:33.245572 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:33.245859 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:33.354246 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:33.354467 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:33.653374 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:33.654644 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 426 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:33.654887 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:33.684855 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00107: 128cf77d1e94446f65af808ff62548dd {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:33.685002 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:33.717204 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:33.970866 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:33.971100 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:34.079877 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:34.080407 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:34.426989 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:34.522324 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:34.523084 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 68 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:34.523248 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:34.556228 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00108: 0ac8838eee7696114147d95e0878e3b2 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:34.559751 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:34.687615 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:34.687827 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:34.790769 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:34.790931 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:35.167433 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:35.429706 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:35.429884 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:35.478391 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:35.479417 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 65536 bytes of data to 438 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:35.479627 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:35.503759 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00109: e23e3c06cc61fb27cf2c900dc53549d6 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:35.503927 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:35.534967 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:35.535223 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:35.663240 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:51:35.669933 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:51:35.670561 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:51:35.675340 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:51:35.676072 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:51:35.679585 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:51:35.679922 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025129/az_nova_backup_7698cfa4-5084-4b6d-a933-fc2f2426bc0b_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:51:35.752226 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:51:35.752970 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] _write_metadata started, container name: volumebackups, metadata filename: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025129/az_nova_backup_7698cfa4-5084-4b6d-a933-fc2f2426bc0b_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:51:35.790135 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "7698cfa4-5084-4b6d-a933-fc2f2426bc0b",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1545465442",\n "created_at": "2026-06-26 02:51:26+00:00",\n "objects": [],\n "parent_id": "7dc3a78c-0502-4c69-8a46-5552cef8b3fc",\n "version": "1.0.0",\n "volume_id": "1ccea677-9f74-4cf7-b159-cf84d9345e2e",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"1ccea677-9f74-4cf7-b159-cf84d9345e2e\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"76814a8561f64788a98990bb48923696\\", \\"project_id\\": \\"56301a4e8d3e4c228f3a24467568fd7b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:50:37.000000\\", \\"launched_at\\": \\"2026-06-26T02:50:37.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-655094110\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:50:36.000000\\", \\"updated_at\\": \\"2026-06-26T02:51:26.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:51:35.799334 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] backup 7698cfa4-5084-4b6d-a933-fc2f2426bc0b finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:51:35.931107 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:35.968923 np0000003683 sudo[143702]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jun 26 02:51:35.969577 np0000003683 sudo[143702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:51:35.988993 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:36.043352 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:36.044163 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Compressed 32768 bytes of data to 258 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:36.044354 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:36.078094 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00110: ccd615116dcb4026c3f50f53f219fe04 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:36.078309 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:36.086489 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:51:36.095641 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:51:36.095641 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:51:36.102176 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:51:36.102340 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:51:36.108503 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jun 26 02:51:36.108503 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:51:36.181014 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:51:36.181743 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] _write_metadata started, container name: volumebackups, metadata filename: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:51:36.221666 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "062f5886-9ca3-4c9a-a1cd-3743554c42fb",\n "backup_name": "tempest-VolumesBackupsTest-Backup-652998502",\n "created_at": "2026-06-26 02:51:21+00:00",\n "objects": [\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00001": {\n "compression": "zlib",\n "length": 32768,\n "md5": "7455b0146d203e0450dd14035351df50",\n "offset": 0\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00002": {\n "compression": "zlib",\n "length": 294912,\n "md5": "bf10bad2c2f7cac677c071e7fc3cd4f8",\n "offset": 9437184\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00003": {\n "compression": "zlib",\n "length": 2260992,\n "md5": "5951aaff2a4cd21fe8d2369f620cad44",\n "offset": 16023552\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00004": {\n "compression": "zlib",\n "length": 98304,\n "md5": "e1554f9208060479cb8c0e2b20ce3092",\n "offset": 20283392\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00005": {\n "compression": "zlib",\n "length": 360448,\n "md5": "260e04b2b4be4a8fb9af5bcaeef77f5e",\n "offset": 20414464\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00006": {\n "compression": "zlib",\n "length": 262144,\n "md5": "7e4882497657c646c554c5ad835c0cf5",\n "offset": 20840448\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00007": {\n "compression": "zlib",\n "length": 32768,\n "md5": "00b51f0b7326fd750bdff6f26937507f",\n "offset": 21364736\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00008": {\n "compression": "zlib",\n "length": 524288,\n "md5": "2b4dd274f6d67639fece6f6ec106817b",\n "offset": 21528576\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00009": {\n "compression": "zlib",\n "length": 98304,\n "md5": "807f8f1c74646a8f9592027f16d2643d",\n "offset": 22085632\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00010": {\n "compression": "zlib",\n "length": 65536,\n "md5": "035de9616151b09d26063aaf3786be98",\n "offset": 22282240\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00011": {\n "compression": "zlib",\n "length": 327680,\n "md5": "f941eba3270410ec15b7aff819b8b0c0",\n "offset": 22478848\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00012": {\n "compression": "zlib",\n "length": 327680,\n "md5": "ba683c210943a225502816568e3b8d00",\n "offset": 22872064\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00013": {\n "compression": "zlib",\n "length": 65536,\n "md5": "e88548713f69de90eef0cd6c4e9796dd",\n "offset": 23265280\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00014": {\n "compression": "zlib",\n "length": 393216,\n "md5": "01e3e2d3510c4223690a6849e71496ab",\n "offset": 23396352\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00015": {\n "compression": "zlib",\n "length": 131072,\n "md5": "599805a91aa71f961c3787a61e7c5729",\n "offset": 23855104\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00016": {\n "compression": "zlib",\n "length": 65536,\n "md5": "179b961161bdaa477c7c01ad80585eee",\n "offset": 24051712\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00017": {\n "compression": "zlib",\n "length": 131072,\n "md5": "d27aa048e7ec9b4cbc6afc435ead70f6",\n "offset": 24510464\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00018": {\n "compression": "zlib",\n "length": 786432,\n "md5": "93a49a74b3f385db27466765f9e213d9",\n "offset": 24707072\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00019": {\n "compression": "zlib",\n "length": 65536,\n "md5": "fb0b4c9f443eae7a19740e071a10002c",\n "offset": 25624576\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00020": {\n "compression": "zlib",\n "length": 2293760,\n "md5": "561fc7e20667dfc9156b44fb725f7a41",\n "offset": 26214400\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00021": {\n "compression": "zlib",\n "length": 262144,\n "md5": "600a0ec270d9626014f041f394a91dec",\n "offset": 28606464\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00022": {\n "compression": "zlib",\n "length": 65536,\n "md5": "d74672ad69032d6511c7f86b7b0cdb23",\n "offset": 29032448\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00023": {\n "compression": "zlib",\n "length": 98304,\n "md5": "b26d859ed07de20dd16d0c165a4e6a3a",\n "offset": 29425664\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00024": {\n "compression": "zlib",\n "length": 294912,\n "md5": "17812a659c805b2d08ad0ffbac17f523",\n "offset": 29622272\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00025": {\n "compression": "zlib",\n "length": 65536,\n "md5": "900ba3be5febaa4a7e8d4fe06a9e5bbe",\n "offset": 30081024\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00026": {\n "compression": "zlib",\n "length": 32768,\n "md5": "7b83ad270600f54dc0ce5f973398f4a1",\n "offset": 30212096\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00027": {\n "compression": "zlib",\n "length": 32768,\n "md5": "a31179c9f17d2086e474bbff2d8b9fa5",\n "offset": 30343168\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00028": {\n "compression": "zlib",\n "length": 98304,\n "md5": "86d6719d73ca0214c25634aedc7fe9d9",\n "offset": 32636928\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00029": {\n "compression": "zlib",\n "length": 98304,\n "md5": "fdf44fcafc023cb46fe41182b8e073b8",\n "offset": 32833536\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00030": {\n "compression": "zlib",\n "length": 524288,\n "md5": "5815c96da9bc9be47f2dde7f69ddd130",\n "offset": 33030144\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00031": {\n "compression": "zlib",\n "length": 131072,\n "md5": "7ecd5b62ea9a77dd27d5058cc0b2af3a",\n "offset": 33619968\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00032": {\n "compression": "zlib",\n "length": 294912,\n "md5": "185eea5b60ee84638ea2ef67b051e400",\n "offset": 33849344\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00033": {\n "compression": "zlib",\n "length": 32768,\n "md5": "e41a77e44d240ad8104d5fb9712151e4",\n "offset": 34275328\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00034": {\n "compression": "zlib",\n "length": 65536,\n "md5": "a7a0eee90ff873fe50f294cf33e7de2d",\n "offset": 34406400\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00035": {\n "compression": "zlib",\n "length": 65536,\n "md5": "5a96fd0be63a553958c90d4a4316c4de",\n "offset": 34537472\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00036": {\n "compression": "zlib",\n "length": 98304,\n "md5": "b02b4173598f30151430937bc55a6faf",\n "offset": 38797312\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00037": {\n "compression": "zlib",\n "length": 262144,\n "md5": "b7e2d07e021e740544325541d67b7329",\n "offset": 38928384\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00038": {\n "compression": "zlib",\n "length": 32768,\n "md5": "00fb2cc13328ca425a2eca1e6c7c4e6d",\n "offset": 39256064\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00039": {\n "compression": "zlib",\n "length": 32768,\n "md5": "d11036511ad7f5dbe776a742c58f87ea",\n "offset": 40370176\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00040": {\n "compression": "zlib",\n "length": 32768,\n "md5": "c4ed5bf65e3847ac3a3103aeb9f043f9",\n "offset": 40566784\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00041": {\n "compression": "zlib",\n "length": 32768,\n "md5": "2abba25a77ee36c58131400ef11e9b33",\n "offset": 40697856\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00042": {\n "compression": "zlib",\n "length": 65536,\n "md5": "58c33934aea3dc04d999003f5971d3e1",\n "offset": 40828928\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00043": {\n "compression": "zlib",\n "length": 65536,\n "md5": "90971d6560092661366d4a8e0d690316",\n "offset": 46399488\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00044": {\n "compression": "zlib",\n "length": 32768,\n "md5": "6d63cabe5cbd45d0e7748b702fb3237f",\n "offset": 46596096\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00045": {\n "compression": "zlib",\n "length": 229376,\n "md5": "b63363b73e33269b13a4b9007772caea",\n "offset": 52199424\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00046": {\n "compression": "zlib",\n "length": 32768,\n "md5": "7ad27b3399ebe8e17313a1edd45d2a4c",\n "offset": 52428800\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00047": {\n "compression": "zlib",\n "length": 65536,\n "md5": "b2f4bed0ea8034625ddd32034addd197",\n "offset": 52494336\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00048": {\n "compression": "zlib",\n "length": 65536,\n "md5": "e2ae44a38272f3786b389fe25de025f7",\n "offset": 52592640\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00049": {\n "compression": "zlib",\n "length": 131072,\n "md5": "459edd959d71fc76632140b2c1c2afd7",\n "offset": 52756480\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00050": {\n "compression": "zlib",\n "length": 262144,\n "md5": "9f03bd9a5f1f3681ce923853068a5391",\n "offset": 52953088\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00051": {\n "compression": "zlib",\n "length": 32768,\n "md5": "808b8e5ae0ebfa3ebee1f25e56d7380e",\n "offset": 53280768\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00052": {\n "compression": "zlib",\n "length": 2162688,\n "md5": "9c92fcd1cade265364aca0fbf2615bff",\n "offset": 53411840\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00053": {\n "compression": "zlib",\n "length": 131072,\n "md5": "ac2c3b7f365746cfcedfa3644641f133",\n "offset": 55640064\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00054": {\n "compression": "zlib",\n "length": 262144,\n "md5": "d4e16afa8ee08db846e947df5b4ec08b",\n "offset": 55869440\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00055": {\n "compression": "zlib",\n "length": 196608,\n "md5": "86d6f3eb5f3f66b3bd977ec8c039a49c",\n "offset": 56295424\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00056": {\n "compression": "zlib",\n "length": 196608,\n "md5": "933534e51561c890b382aa9eb4c5764c",\n "offset": 56557568\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00057": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0f7cdc5b89fbb7316ab86f111715879e",\n "offset": 56819712\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00058": {\n "compression": "zlib",\n "length": 65536,\n "md5": "b3534e7bd21436d93d6e15ceae51ecbb",\n "offset": 56950784\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00059": {\n "compression": "zlib",\n "length": 65536,\n "md5": "308e5172c7191c405029e68eb339b63e",\n "offset": 57081856\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00060": {\n "compression": "zlib",\n "length": 98304,\n "md5": "87fed698449bb429c84cea142b47074f",\n "offset": 57212928\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00061": {\n "compression": "zlib",\n "length": 32768,\n "md5": "8577057e39906809834d6bbe62984d84",\n "offset": 57475072\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00062": {\n "compression": "zlib",\n "length": 2162688,\n "md5": "286f32389d41ccb3a7454011b7fe833b",\n "offset": 57606144\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00063": {\n "compression": "zlib",\n "length": 131072,\n "md5": "07f83a91f2a65593c97ccde75e2cdb1a",\n "offset": 59834368\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00064": {\n "compression": "zlib",\n "length": 32768,\n "md5": "472694eb9fd935b65a675e05db84ae55",\n "offset": 60030976\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00065": {\n "compression": "zlib",\n "length": 163840,\n "md5": "7bbd91225a7ad728f1ee251495d662a3",\n "offset": 60227584\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00066": {\n "compression": "zlib",\n "length": 196608,\n "md5": "9c2c443a510acae20e828ca784ea0ef0",\n "offset": 60489728\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00067": {\n "compression": "zlib",\n "length": 32768,\n "md5": "f15596026d78fb5a6c33e31e645c1bc0",\n "offset": 60751872\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00068": {\n "compression": "zlib",\n "length": 131072,\n "md5": "01e07b6ff49d49600cff2b5f037b5585",\n "offset": 60882944\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00069": {\n "compression": "zlib",\n "length": 196608,\n "md5": "2cc1e5bb8b0f7f6b8f396071b242c82d",\n "offset": 61145088\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00070": {\n "compression": "zlib",\n "length": 2555904,\n "md5": "77a339075c2c22a3b220b8be3eafd00a",\n "offset": 61407232\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00071": {\n "compression": "zlib",\n "length": 196608,\n "md5": "4976e1dea54e67ed34a48147acf51f95",\n "offset": 64028672\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00072": {\n "compression": "zlib",\n "length": 32768,\n "md5": "c5102cf8b89d0646b4a8454aa2eb455b",\n "offset": 64290816\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00073": {\n "compression": "zlib",\n "length": 262144,\n "md5": "a90b39452df564cdaee1875cdf14648d",\n "offset": 64356352\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00074": {\n "compression": "zlib",\n "length": 196608,\n "md5": "93190166bf0c7415bc69f707aeecba3d",\n "offset": 64684032\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00075": {\n "compression": "zlib",\n "length": 753664,\n "md5": "f20b7ef7942c255d34567ef7a8c931d5",\n "offset": 64946176\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00076": {\n "compression": "zlib",\n "length": 1245184,\n "md5": "2fec27600c3cba1475524f3a83a147d9",\n "offset": 65863680\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00077": {\n "compression": "zlib",\n "length": 229376,\n "md5": "bd18e2aa13a8966c7ccaeb4a8d2ad111",\n "offset": 67174400\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00078": {\n "compression": "zlib",\n "length": 196608,\n "md5": "2742a11d6ef6f40794ba3a77fdd91fc1",\n "offset": 67567616\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00079": {\n "compression": "zlib",\n "length": 753664,\n "md5": "937919e06f1ac884e907b3b44f7aa3f7",\n "offset": 67829760\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00080": {\n "compression": "zlib",\n "length": 32768,\n "md5": "80bf1a781b69ed6d28f051a8c1bace93",\n "offset": 68681728\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00081": {\n "compression": "zlib",\n "length": 98304,\n "md5": "839ea305330c068b1e25e10bbe0072eb",\n "offset": 68878336\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00082": {\n "compression": "zlib",\n "length": 196608,\n "md5": "e35f12e70225bea64f1d64820a8c34af",\n "offset": 69140480\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00083": {\n "compression": "zlib",\n "length": 32768,\n "md5": "b64ba69a7c7b92cbb6e034a227c535e1",\n "offset": 69402624\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00084": {\n "compression": "zlib",\n "length": 163840,\n "md5": "7271b184b3a0862c0307275252dd4c26",\n "offset": 69468160\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00085": {\n "compression": "zlib",\n "length": 196608,\n "md5": "534ab1b26cf91adf3fcf3f10f1b565b6",\n "offset": 69795840\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00086": {\n "compression": "zlib",\n "length": 524288,\n "md5": "7b93fd040fdb51b64825f978837710a0",\n "offset": 70254592\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00087": {\n "compression": "zlib",\n "length": 98304,\n "md5": "37d447129a7727064c85371ab726a3d9",\n "offset": 71041024\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00088": {\n "compression": "zlib",\n "length": 32768,\n "md5": "69d1884fb24558398ae7f36ef9ba922e",\n "offset": 71172096\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00089": {\n "compression": "zlib",\n "length": 262144,\n "md5": "a77c3df81950fe3ec6756b32c47d5889",\n "offset": 72417280\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00090": {\n "compression": "zlib",\n "length": 65536,\n "md5": "c15a2e2eb7fb41df1e140bbf87c78a9c",\n "offset": 110100480\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00091": {\n "compression": "zlib",\n "length": 196608,\n "md5": "d2f8fd157e57c49a2e7fbb7db668bdfa",\n "offset": 110297088\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00092": {\n "compression": "zlib",\n "length": 65536,\n "md5": "ab4c3c6565d120e31d0ec092b1f40fc0",\n "offset": 110559232\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00093": {\n "compression": "zlib",\n "length": 32768,\n "md5": "6df3fb11329fda670b6a648b803a75c3",\n "offset": 110690304\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00094": {\n "compression": "zlib",\n "length": 32768,\n "md5": "d3338725ce0b00d0d0a20c3dc76363b5",\n "offset": 110821376\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00095": {\n "compression": "zlib",\n "length": 557056,\n "md5": "736df86bae8f6a9fbe7631cf877d988c",\n "offset": 110952448\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00096": {\n "compression": "zlib",\n "length": 131072,\n "md5": "5465c211d4134a5c770e5e96d9420f8b",\n "offset": 111607808\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00097": {\n "compression": "zlib",\n "length": 32768,\n "md5": "125fb29df3a88ed91bb536861e7d1ff9",\n "offset": 111869952\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00098": {\n "compression": "zlib",\n "length": 98304,\n "md5": "38a20f8b3afb8be4ea4deab5f9b3d080",\n "offset": 112001024\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00099": {\n "compression": "zlib",\n "length": 131072,\n "md5": "f87eeae8e3222a88fc335a905cc595f5",\n "offset": 112197632\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00100": {\n "compression": "zlib",\n "length": 131072,\n "md5": "a34ec244a0a06a62255379762d3da663",\n "offset": 112590848\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00101": {\n "compression": "zlib",\n "length": 393216,\n "md5": "ce40a8df09b1374e7997af78065811c8",\n "offset": 113770496\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00102": {\n "compression": "zlib",\n "length": 32768,\n "md5": "5649b75a126d07b66d0cec64e48b81cf",\n "offset": 114229248\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00103": {\n "compression": "zlib",\n "length": 65536,\n "md5": "b774092da94395745bdde14d566359fd",\n "offset": 143654912\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00104": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0ac8838eee7696114147d95e0878e3b2",\n "offset": 277872640\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00105": {\n "compression": "zlib",\n "length": 65536,\n "md5": "bd4124b1385706f9ca588341db581eee",\n "offset": 412090368\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00106": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0ac8838eee7696114147d95e0878e3b2",\n "offset": 546308096\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00107": {\n "compression": "zlib",\n "length": 65536,\n "md5": "128cf77d1e94446f65af808ff62548dd",\n "offset": 680525824\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00108": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0ac8838eee7696114147d95e0878e3b2",\n "offset": 814743552\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00109": {\n "compression": "zlib",\n "length": 65536,\n "md5": "e23e3c06cc61fb27cf2c900dc53549d6",\n "offset": 948961280\n }\n },\n {\n "volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00110": {\n "compression": "zlib",\n "length": 32768,\n "md5": "ccd615116dcb4026c3f50f53f219fe04",\n "offset": 1073709056\n }\n }\n ],\n "parent_id": "5464cf72-b70d-4129-ba1b-1c34c4c31aae",\n "version": "1.0.0",\n "volume_id": "a5fbcabf-ce3a-4fad-9b90-c7b9003301d0",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"a5fbcabf-ce3a-4fad-9b90-c7b9003301d0\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"6abcc90720de4d3e8d49aa5c4bb02b11\\", \\"project_id\\": \\"7a0a7fdd73fc40328c4c73ef53edc697\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:49:52.000000\\", \\"launched_at\\": \\"2026-06-26T02:49:52.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-2017360747\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:49:52.000000\\", \\"updated_at\\": \\"2026-06-26T02:51:21.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"eb0918cd-17b7-4dc6-8a46-002286996c07\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:51:36.229141 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] backup 062f5886-9ca3-4c9a-a1cd-3743554c42fb finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:51:36.232575 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:36.249841 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:36.250062 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:36.253887 np0000003683 sudo[143734]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jun 26 02:51:36.254517 np0000003683 sudo[143734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:51:36.292726 np0000003683 sudo[143702]: pam_unix(sudo:session): session closed for user root Jun 26 02:51:36.294966 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.364s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:51:36.295140 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799080', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:36.295342 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:36.295895 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:36.296288 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ccea677-9f74-4cf7-b159-cf84d9345e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:36.306894 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:36.307518 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:51:36.307518 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:51:36.307518 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:51:36.307518 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:51:36.332705 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:36.332705 np0000003683 cinder-backup[101221]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:36.332705 np0000003683 cinder-backup[101221]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:36.332705 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:36.332705 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:36.332705 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:36.332705 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:36.332705 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:36.333082 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] iscsi session list stdout=tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:36.333082 np0000003683 cinder-backup[101221]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:36.333082 np0000003683 cinder-backup[101221]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e (non-flash) Jun 26 02:51:36.333082 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:36.333082 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:36.333082 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:36.333082 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:36.333082 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:36.333082 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:51:36.333298 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e', '133')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:51:36.334065 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Resulting device map defaultdict(. at 0x79db78f60a40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e'): ({'sdb'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:51:36.334286 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Removing single pathed devices sdb {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:51:36.344249 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Flushing IO for device /dev/sdb {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:51:36.351734 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:51:36.363653 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:36.363825 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:36.401926 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:51:36.402126 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] SCSI volumes sdb have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:51:36.404045 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:51:36.418318 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:51:36.418596 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:51:36.429547 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:36.463067 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 133, target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, portal: 192.168.40.100,3260] Jun 26 02:51:36.463067 np0000003683 cinder-backup[101221]: Logout of [sid: 133, target: iqn.2023-03.storpool.com:os--volume-1ccea677-9f74-4cf7-b159-cf84d9345e2e, portal: 192.168.40.100,3260] successful. Jun 26 02:51:36.463067 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:36.477298 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:36.477731 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.182s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:36.478103 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] <== disconnect_volume: return (182ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:36.486439 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:36.640288 np0000003683 sudo[143734]: pam_unix(sudo:session): session closed for user root Jun 26 02:51:36.642047 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.410s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:51:36.642439 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000c7f4e315', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:36.642623 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:36.642932 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:36.643225 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:36.652992 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:36.653506 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:51:36.653506 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:51:36.653506 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:51:36.653506 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:51:36.678497 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:36.678497 np0000003683 cinder-backup[101221]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:36.678497 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:36.678497 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:36.678497 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:36.678497 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:36.678497 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:36.678738 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:36.678738 np0000003683 cinder-backup[101221]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0 (non-flash) Jun 26 02:51:36.678738 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:36.678738 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:36.678738 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:36.678738 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:36.678738 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:36.678967 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:51:36.679148 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0', '132')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:51:36.680308 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Resulting device map defaultdict(. at 0x79db5a820a40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0'): ({'sdd'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:51:36.680916 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Removing multipathed devices sdd {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:51:36.681292 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Flush multipath device 330000000c7f4e315 {{(pid=101221) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 02:51:36.818768 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:36.818949 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:36.860271 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Flushing IO for device /dev/sdd {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:51:36.868804 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:51:36.879388 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:36.879388 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:36.887726 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:51:36.893537 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:51:36.893740 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:51:36.897290 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:51:36.897424 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:51:36.900111 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jun 26 02:51:36.900344 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-859090827, sha256file filename: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:51:36.919314 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:51:36.919605 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] SCSI volumes sdd have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:51:36.921073 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:51:36.931492 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:51:36.931704 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:51:36.941969 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:36.960241 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:51:36.961206 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-859090827, metadata filename: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:51:36.986376 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 132, target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, portal: 192.168.40.100,3260] Jun 26 02:51:36.986376 np0000003683 cinder-backup[101221]: Logout of [sid: 132, target: iqn.2023-03.storpool.com:os--volume-a5fbcabf-ce3a-4fad-9b90-c7b9003301d0, portal: 192.168.40.100,3260] successful. Jun 26 02:51:36.986376 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:37.000405 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "7addc0a1-2cd8-4ab2-9778-17721e2a28e9",\n "backup_name": "tempest-VolumesBackupsTest-Backup-225240867",\n "created_at": "2026-06-26 02:51:18+00:00",\n "objects": [\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "82571f7121cb9475563edde615e4e4df",\n "offset": 0\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "a35891500449df17e893f84bd88472fb",\n "offset": 104857600\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "e876102a-9311-44e0-a8aa-8128f39b45ec",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"e876102a-9311-44e0-a8aa-8128f39b45ec\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"3f08f0507eec40189b858129b4cc7fd1\\", \\"project_id\\": \\"c05f689c58a04254b3930f0cc279148c\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:51:17.000000\\", \\"launched_at\\": \\"2026-06-26T02:51:17.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-958621306\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:51:17.000000\\", \\"updated_at\\": \\"2026-06-26T02:51:18.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"eb0918cd-17b7-4dc6-8a46-002286996c07\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:51:37.004174 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:37.004428 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:37.004586 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] <== disconnect_volume: return (361ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:37.014277 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] backup 7addc0a1-2cd8-4ab2-9778-17721e2a28e9 finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:51:37.143196 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:37.163003 np0000003683 sudo[143804]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Jun 26 02:51:37.163624 np0000003683 sudo[143804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:51:37.477692 np0000003683 sudo[143804]: pam_unix(sudo:session): session closed for user root Jun 26 02:51:37.480073 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.337s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:51:37.480747 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e876102a-9311-44e0-a8aa-8128f39b45ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799088', 'path': '/dev/sdc'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:37.480955 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:37.518469 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-77ccd7d5-fe6a-4389-b43a-3c5bec2b6a53 tempest-VolumesBackupsTest-665014974 None] Create backup finished. backup: 7698cfa4-5084-4b6d-a933-fc2f2426bc0b. Jun 26 02:51:38.036105 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-cac3b6dd-c3cc-4707-9f88-e8f9a17372a9 tempest-VolumesBackupsTest-232973889 None] Create backup finished. backup: 062f5886-9ca3-4c9a-a1cd-3743554c42fb. Jun 26 02:51:38.482590 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] Delete backup started, backup: 062f5886-9ca3-4c9a-a1cd-3743554c42fb. Jun 26 02:51:38.489629 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_7a0a7fdd73fc40328c4c73ef53edc697 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:51:38.489851 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:51:38.490038 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] delete started, backup: 062f5886-9ca3-4c9a-a1cd-3743554c42fb, container: volumebackups, prefix: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:51:38.534858 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] generated object list: ['volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00001', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00002', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00003', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00004', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00005', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00006', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00007', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00008', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00009', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00010', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00011', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00012', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00013', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00014', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00015', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00016', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00017', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00018', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00019', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00020', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00021', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00022', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00023', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00024', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00025', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00026', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00027', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00028', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00029', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00030', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00031', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00032', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00033', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00034', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00035', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00036', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00037', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00038', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00039', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00040', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00041', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00042', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00043', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00044', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00045', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00046', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00047', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00048', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00049', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00050', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00051', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00052', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00053', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00054', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00055', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00056', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00057', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00058', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00059', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00060', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00061', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00062', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00063', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00064', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00065', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00066', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00067', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00068', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00069', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00070', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00071', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00072', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00073', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00074', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00075', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00076', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00077', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00078', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00079', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00080', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00081', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00082', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00083', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00084', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00085', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00086', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00087', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00088', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00089', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00090', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00091', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00092', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00093', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00094', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00095', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00096', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00097', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00098', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00099', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00100', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00101', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00102', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00103', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00104', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00105', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00106', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00107', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00108', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00109', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00110', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb_metadata', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:51:38.553012 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00001 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.557286 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-1a6a6663-d9c5-458c-99cd-baa952f490c5 tempest-VolumesBackupsTest-665014974 None] Delete backup started, backup: 7698cfa4-5084-4b6d-a933-fc2f2426bc0b. Jun 26 02:51:38.557931 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-1a6a6663-d9c5-458c-99cd-baa952f490c5 tempest-VolumesBackupsTest-665014974 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_56301a4e8d3e4c228f3a24467568fd7b {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:51:38.558074 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-1a6a6663-d9c5-458c-99cd-baa952f490c5 tempest-VolumesBackupsTest-665014974 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:51:38.558228 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a6a6663-d9c5-458c-99cd-baa952f490c5 tempest-VolumesBackupsTest-665014974 None] delete started, backup: 7698cfa4-5084-4b6d-a933-fc2f2426bc0b, container: volumebackups, prefix: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025129/az_nova_backup_7698cfa4-5084-4b6d-a933-fc2f2426bc0b. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:51:38.573962 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00002 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.593786 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00003 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.596657 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a6a6663-d9c5-458c-99cd-baa952f490c5 tempest-VolumesBackupsTest-665014974 None] generated object list: ['volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025129/az_nova_backup_7698cfa4-5084-4b6d-a933-fc2f2426bc0b_metadata', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025129/az_nova_backup_7698cfa4-5084-4b6d-a933-fc2f2426bc0b_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:51:38.614001 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00004 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.617154 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a6a6663-d9c5-458c-99cd-baa952f490c5 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025129/az_nova_backup_7698cfa4-5084-4b6d-a933-fc2f2426bc0b_metadata in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.632319 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00005 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.636951 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a6a6663-d9c5-458c-99cd-baa952f490c5 tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025129/az_nova_backup_7698cfa4-5084-4b6d-a933-fc2f2426bc0b_sha256file in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.637150 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a6a6663-d9c5-458c-99cd-baa952f490c5 tempest-VolumesBackupsTest-665014974 None] delete 7698cfa4-5084-4b6d-a933-fc2f2426bc0b finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:51:38.662548 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00006 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.671405 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-1a6a6663-d9c5-458c-99cd-baa952f490c5 tempest-VolumesBackupsTest-665014974 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:51:38.681069 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00007 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.687017 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-1a6a6663-d9c5-458c-99cd-baa952f490c5 tempest-VolumesBackupsTest-665014974 None] Created reservations ['7ac52c01-8688-492c-a8ac-63ff7027562c', '1ba818bd-3951-4786-be9d-98be60bfa7d8'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:51:38.702489 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00008 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.712598 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-1a6a6663-d9c5-458c-99cd-baa952f490c5 tempest-VolumesBackupsTest-665014974 None] Delete backup finished, backup 7698cfa4-5084-4b6d-a933-fc2f2426bc0b deleted. Jun 26 02:51:38.723133 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00009 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.740871 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00010 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.759699 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00011 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.777208 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00012 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.795990 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00013 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.815275 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00014 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.838261 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00015 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.860029 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00016 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.878367 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00017 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.908011 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00018 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.922445 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00019 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.941421 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00020 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.962019 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00021 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:38.982213 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00022 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.001892 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00023 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.020323 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00024 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.039194 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00025 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.057492 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00026 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.077035 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00027 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.096144 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00028 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.115468 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00029 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.135560 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00030 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.156064 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00031 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.174636 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00032 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.192604 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00033 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.211090 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00034 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.230830 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00035 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.249939 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00036 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.268455 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00037 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.287388 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00038 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.307586 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00039 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.329129 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00040 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.350760 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00041 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.371605 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00042 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.393901 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00043 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.413116 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00044 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.433828 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00045 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.455032 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00046 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.474597 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00047 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.496745 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00048 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.517014 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00049 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.534937 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00050 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.555184 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00051 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.577662 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00052 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.597459 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00053 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.618589 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-10091dc7-e4bc-4a6e-ba9c-6ccf60e8ca40 tempest-VolumesBackupsTest-2142713548 None] Delete backup started, backup: de3bd523-0811-41c0-8f27-51766a270512. Jun 26 02:51:39.620514 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-10091dc7-e4bc-4a6e-ba9c-6ccf60e8ca40 tempest-VolumesBackupsTest-2142713548 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_ec9765c5e68d4391876fe64b00b50ea0 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:51:39.620799 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-10091dc7-e4bc-4a6e-ba9c-6ccf60e8ca40 tempest-VolumesBackupsTest-2142713548 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:51:39.621014 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-10091dc7-e4bc-4a6e-ba9c-6ccf60e8ca40 tempest-VolumesBackupsTest-2142713548 None] delete started, backup: de3bd523-0811-41c0-8f27-51766a270512, container: volumebackups, prefix: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025118/az_nova_backup_de3bd523-0811-41c0-8f27-51766a270512. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:51:39.622818 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00054 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.655565 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00055 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.669503 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-10091dc7-e4bc-4a6e-ba9c-6ccf60e8ca40 tempest-VolumesBackupsTest-2142713548 None] generated object list: ['volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025118/az_nova_backup_de3bd523-0811-41c0-8f27-51766a270512_metadata', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025118/az_nova_backup_de3bd523-0811-41c0-8f27-51766a270512_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:51:39.679794 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00056 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.692595 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-10091dc7-e4bc-4a6e-ba9c-6ccf60e8ca40 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025118/az_nova_backup_de3bd523-0811-41c0-8f27-51766a270512_metadata in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.701629 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00057 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.713416 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-10091dc7-e4bc-4a6e-ba9c-6ccf60e8ca40 tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025118/az_nova_backup_de3bd523-0811-41c0-8f27-51766a270512_sha256file in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.713616 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-10091dc7-e4bc-4a6e-ba9c-6ccf60e8ca40 tempest-VolumesBackupsTest-2142713548 None] delete de3bd523-0811-41c0-8f27-51766a270512 finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:51:39.739110 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00058 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.747318 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-10091dc7-e4bc-4a6e-ba9c-6ccf60e8ca40 tempest-VolumesBackupsTest-2142713548 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:51:39.759018 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00059 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.762677 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-10091dc7-e4bc-4a6e-ba9c-6ccf60e8ca40 tempest-VolumesBackupsTest-2142713548 None] Created reservations ['3488ad1c-0906-45f6-9bb4-c29e4ed62378', '3800303e-9327-4046-a353-93983246de7f'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:51:39.782761 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00060 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.796460 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-10091dc7-e4bc-4a6e-ba9c-6ccf60e8ca40 tempest-VolumesBackupsTest-2142713548 None] Delete backup finished, backup de3bd523-0811-41c0-8f27-51766a270512 deleted. Jun 26 02:51:39.806049 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00061 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.823520 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00062 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.842372 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00063 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.861838 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00064 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.884529 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00065 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.906293 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00066 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.923593 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00067 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.941330 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00068 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.959226 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00069 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.976362 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00070 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:39.992014 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00071 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.009220 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00072 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.027383 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00073 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.043824 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00074 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.061140 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00075 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.073257 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.592s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:40.073711 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e876102a-9311-44e0-a8aa-8128f39b45ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:51:40.077866 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00076 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:40.084666 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:40.085424 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:51:40.085424 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:51:40.085424 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:51:40.085424 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:51:40.097638 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00077 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.109258 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:40.109258 np0000003683 cinder-backup[101221]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:40.109258 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:40.109258 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:40.109258 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:40.109258 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:40.109258 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:40.109258 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:40.109601 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec (non-flash) Jun 26 02:51:40.109601 np0000003683 cinder-backup[101221]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:40.109601 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:40.109601 np0000003683 cinder-backup[101221]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:40.109601 np0000003683 cinder-backup[101221]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9 (non-flash) Jun 26 02:51:40.109601 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:40.109601 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:40.109601 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:40.109601 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fac428e5-dfe8-4ea8-8b8c-e41d09a491b9', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094', '95')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:51:40.109886 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec', '131')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:51:40.110550 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Resulting device map defaultdict(. at 0x79db5a24e840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec'): ({'sdc'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:51:40.110741 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Removing single pathed devices sdc {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:51:40.117965 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00078 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.120981 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Flushing IO for device /dev/sdc {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:51:40.127868 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:51:40.136020 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00079 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.155908 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00080 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.173995 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00081 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.187849 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:51:40.188072 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] SCSI volumes sdc have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:51:40.189111 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Checking to see if device paths {'sdc'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:51:40.192387 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00082 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.197869 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Device paths {'sdc'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:51:40.198120 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:51:40.206645 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:40.211147 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00083 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.229140 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00084 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.241120 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 131, target: iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec, portal: 192.168.40.100,3260] Jun 26 02:51:40.241120 np0000003683 cinder-backup[101221]: Logout of [sid: 131, target: iqn.2023-03.storpool.com:os--volume-e876102a-9311-44e0-a8aa-8128f39b45ec, portal: 192.168.40.100,3260] successful. Jun 26 02:51:40.241120 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:40.249075 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00085 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.255826 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:40.256040 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.183s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:40.256192 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] <== disconnect_volume: return (2775ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:40.267486 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00086 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.286538 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00087 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.305490 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00088 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.324136 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00089 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.344910 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00090 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.363291 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00091 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.382383 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00092 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.403066 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00093 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.420886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00094 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.440226 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00095 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.458127 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00096 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.477641 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00097 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.500609 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00098 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.521745 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00099 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.541463 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00100 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.560782 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00101 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.580519 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00102 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.599538 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00103 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.617062 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00104 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.634965 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00105 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.653710 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00106 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.672003 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00107 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.684743 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] Delete backup started, backup: 7dc3a78c-0502-4c69-8a46-5552cef8b3fc. Jun 26 02:51:40.688012 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_56301a4e8d3e4c228f3a24467568fd7b {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:51:40.688204 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:51:40.688360 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] delete started, backup: 7dc3a78c-0502-4c69-8a46-5552cef8b3fc, container: volumebackups, prefix: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:51:40.692299 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00108 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.713157 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00109 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.725548 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] generated object list: ['volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00001', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00002', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00003', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00004', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00005', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00006', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00007', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00008', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00009', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00010', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00011', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00012', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00013', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00014', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00015', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00016', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00017', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00018', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00019', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00020', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00021', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc_metadata', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:51:40.731775 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb-00110 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.743594 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00001 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.749269 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb_metadata in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.761336 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00002 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.769655 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626025124/az_nova_backup_062f5886-9ca3-4c9a-a1cd-3743554c42fb_sha256file in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.770059 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] delete 062f5886-9ca3-4c9a-a1cd-3743554c42fb finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:51:40.809745 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00003 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.821535 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:51:40.829585 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00004 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.842891 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] Created reservations ['b33f1c07-686f-42f3-8f67-9ca216dda372', '4b1ababc-9056-43ad-bbc0-0510303177ae'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:51:40.848880 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00005 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.871704 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00006 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.884571 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-605421e7-6b53-4c29-8238-1b31518000f2 tempest-VolumesBackupsTest-232973889 None] Delete backup finished, backup 062f5886-9ca3-4c9a-a1cd-3743554c42fb deleted. Jun 26 02:51:40.893650 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00007 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.911922 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00008 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.930230 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00009 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.952230 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00010 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.969805 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00011 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:40.990703 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00012 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.016893 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00013 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.038459 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00014 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.061586 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00015 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.084684 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00016 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.104483 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00017 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.123365 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00018 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.143858 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00019 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.161457 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00020 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.181085 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc-00021 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.200530 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc_metadata in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.220833 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025100/az_nova_backup_7dc3a78c-0502-4c69-8a46-5552cef8b3fc_sha256file in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.221044 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] delete 7dc3a78c-0502-4c69-8a46-5552cef8b3fc finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:51:41.233967 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] Created reservations ['da09a6fb-ea2d-4c93-a256-b1f3237704eb', '04d90e32-35d3-4ebd-8f3e-b49d3a896947'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:51:41.250807 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-6d8e32b5-fe08-4af6-a1cd-713dbc17d45b tempest-VolumesBackupsTest-665014974 None] Delete backup finished, backup 7dc3a78c-0502-4c69-8a46-5552cef8b3fc deleted. Jun 26 02:51:41.278757 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-338c5fbd-6747-4a00-940d-9c43f682f127 tempest-VolumesBackupsTest-1738581805 None] Create backup finished. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9. Jun 26 02:51:41.744136 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] Delete backup started, backup: 7792e7e4-153e-4c91-b651-a76c2b10d1f7. Jun 26 02:51:41.747402 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_ec9765c5e68d4391876fe64b00b50ea0 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:51:41.747716 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:51:41.747899 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] delete started, backup: 7792e7e4-153e-4c91-b651-a76c2b10d1f7, container: volumebackups, prefix: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:51:41.785519 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] generated object list: ['volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00001', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00002', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00003', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00004', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00005', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00006', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00007', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00008', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00009', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00010', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00011', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00012', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00013', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00014', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00015', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00016', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00017', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00018', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00019', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00020', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00021', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7_metadata', 'volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:51:41.810222 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00001 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.833343 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00002 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.852748 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00003 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.873435 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00004 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.893388 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00005 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.912957 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00006 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.931008 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00007 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.950997 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00008 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.969614 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00009 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.986833 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00010 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:41.997013 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] Delete backup started, backup: 5464cf72-b70d-4129-ba1b-1c34c4c31aae. Jun 26 02:51:41.997739 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_7a0a7fdd73fc40328c4c73ef53edc697 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:51:41.997887 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:51:41.998017 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] delete started, backup: 5464cf72-b70d-4129-ba1b-1c34c4c31aae, container: volumebackups, prefix: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:51:42.006091 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00011 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.028933 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00012 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.044451 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] generated object list: ['volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00001', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00002', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00003', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00004', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00005', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00006', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00007', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00008', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00009', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00010', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00011', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00012', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00013', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00014', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00015', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00016', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00017', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00018', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00019', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00020', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00021', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae_metadata', 'volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:51:42.051297 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00013 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.063127 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00001 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.071043 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00014 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.085154 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00002 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.090712 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00015 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.103306 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00003 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.108347 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00016 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.122085 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00004 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.125853 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00017 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.144545 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00005 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.147305 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00018 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.163957 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00006 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.167303 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00019 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.184586 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00007 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.188401 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00020 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.208931 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00008 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.211110 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7-00021 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.237205 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00009 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.241145 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7_metadata in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.258378 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00010 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.264660 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] deleted object: volume_1ccea677-9f74-4cf7-b159-cf84d9345e2e/20260626025042/az_nova_backup_7792e7e4-153e-4c91-b651-a76c2b10d1f7_sha256file in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.264828 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] delete 7792e7e4-153e-4c91-b651-a76c2b10d1f7 finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:51:42.291848 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00011 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.300326 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:51:42.309526 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00012 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.315188 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] Created reservations ['e95b7138-b5d3-4629-9799-cc28861e9bee', '2392fcfd-d95d-42cf-8750-08195d4d35c6'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:51:42.328370 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00013 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.331099 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-dbc9e215-824b-4f58-9e6a-4d656889b90c tempest-VolumesBackupsTest-2142713548 None] Delete backup finished, backup 7792e7e4-153e-4c91-b651-a76c2b10d1f7 deleted. Jun 26 02:51:42.348496 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00014 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.366233 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00015 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.384582 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00016 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.402490 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00017 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.421571 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00018 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.440448 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00019 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.458048 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00020 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.478508 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae-00021 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.496591 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae_metadata in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.514617 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] deleted object: volume_a5fbcabf-ce3a-4fad-9b90-c7b9003301d0/20260626024956/az_nova_backup_5464cf72-b70d-4129-ba1b-1c34c4c31aae_sha256file in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:42.514864 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] delete 5464cf72-b70d-4129-ba1b-1c34c4c31aae finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:51:42.528647 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] Created reservations ['52bc22cf-77be-4d0e-ae33-5a68307bd16b', '54d84c28-f1cf-495f-b2f4-578c9c30ece1'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:51:42.543720 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-f03e340c-5887-49f1-916c-5b6bdf7f28bb tempest-VolumesBackupsTest-232973889 None] Delete backup finished, backup 5464cf72-b70d-4129-ba1b-1c34c4c31aae deleted. Jun 26 02:51:42.760181 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Restore backup started, backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9 volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. Jun 26 02:51:42.767793 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_c05f689c58a04254b3930f0cc279148c {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:51:42.767945 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:51:42.768235 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:42.777342 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:51:42.797599 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:42.810520 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:51:42.810520 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:51:42.817756 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:51:42.818961 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe52:a7ac', 'fe80::a470:6dff:fef0:3537', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fe58:ad7f', 'fe80::74de:4eff:fe49:517'] Jun 26 02:51:42.819150 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:51:42.819339 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:51:42.819702 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] <== get_connector_properties: return (50ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:43.826543 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:51:43.827079 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5bb5dab9-5479-4cad-9f07-38e52dc32ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:43.827340 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:44.786941 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.959s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:44.787241 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5bb5dab9-5479-4cad-9f07-38e52dc32ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:51:44.810814 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:44.811428 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:44.811674 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:51:44.830582 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:51:44.830582 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:44.841712 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3] added Jun 26 02:51:44.841712 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:51:44.841712 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:51:44.841712 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:51:44.841712 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:51:44.841712 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:51:44.841712 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:44.842277 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:51:44.842277 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:51:44.842547 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:51:45.517729 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:51:45.532582 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Create backup started, backup: 44dab896-8087-41c6-a469-aad465cc8858 volume: e1eb4a88-5b8e-4127-8541-38317a84040d snapshot: c7b8c665-4a1c-4bd6-9737-bf18a3b03ab2. Jun 26 02:51:45.543496 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-06-26T02:51:45Z,data_timestamp=2026-06-26T02:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-411834455',encryption_key_id=None,fail_reason=None,host='np0000003683',id=44dab896-8087-41c6-a469-aad465cc8858,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='7a0a7fdd73fc40328c4c73ef53edc697',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id='c7b8c665-4a1c-4bd6-9737-bf18a3b03ab2',status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='6abcc90720de4d3e8d49aa5c4bb02b11',volume_id=e1eb4a88-5b8e-4127-8541-38317a84040d) Jun 26 02:51:45.617759 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_7a0a7fdd73fc40328c4c73ef53edc697 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:51:45.618025 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:51:45.618330 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:45.627559 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:51:45.644934 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:45.657266 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:51:45.657613 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:51:45.665109 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:51:45.666485 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe14:951c', 'fe80::c0d3:cbff:fefc:6c33', 'fe80::fc16:3eff:fe58:ad7f', 'fe80::74de:4eff:fe49:517', 'fe80::fc16:3eff:feb3:3a57', 'fe80::ec24:c8ff:fe51:231f'] Jun 26 02:51:45.666675 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:51:45.666821 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:51:45.667132 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] <== get_connector_properties: return (48ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:45.843751 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:51:45.856314 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:45.868857 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:45.884130 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:45.884130 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:45.884130 np0000003683 cinder-backup[101221]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:51:45.884130 np0000003683 cinder-backup[101221]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:51:45.884130 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:45.884130 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:45.884130 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:45.884442 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:45.884442 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:45.884442 np0000003683 cinder-backup[101221]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:51:45.884442 np0000003683 cinder-backup[101221]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:51:45.884442 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:45.884442 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:45.884442 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:45.928332 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3, portal: 192.168.40.100,3260] Jun 26 02:51:45.928332 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3, portal: 192.168.40.100,3260] successful. Jun 26 02:51:45.928332 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:45.942397 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:45.962250 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:45.962250 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:45.962250 np0000003683 cinder-backup[101221]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:51:45.962250 np0000003683 cinder-backup[101221]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:51:45.962250 np0000003683 cinder-backup[101221]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash) Jun 26 02:51:45.962250 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:45.962250 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:45.962250 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:45.962528 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:45.962528 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:45.962528 np0000003683 cinder-backup[101221]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:51:45.962528 np0000003683 cinder-backup[101221]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:51:45.962528 np0000003683 cinder-backup[101221]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash) Jun 26 02:51:45.962528 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:45.962528 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:45.962528 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:45.963075 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:45.963075 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:51:45.964059 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] HCTL ('13', '-', '-', 0) found on session 138 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:51:45.965898 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:51:45.980647 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Searching for a device in session 138 and hctl ['13', '*', '*', 0] yield: None {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:51:46.172546 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:51:46.172722 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d0809e-e4dd-4708-a87a-8a4521f5cd3e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:46.172945 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:46.983909 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Searching for a device in session 138 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:51:46.983909 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5bb5dab9-5479-4cad-9f07-38e52dc32ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:51:46.983909 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.196s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:46.983909 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] <== connect_volume: return (3155ms) {'type': 'block', 'scsi_wwn': '330000000e43a14eb', 'path': '/dev/sdh'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:46.983909 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:46.994364 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.820s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:46.995061 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d0809e-e4dd-4708-a87a-8a4521f5cd3e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:51:47.008927 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:47.009381 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:47.009893 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:51:47.005403 np0000003683 sudo[144503]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jun 26 02:51:47.006071 np0000003683 sudo[144503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:51:47.023944 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:51:47.023944 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:47.038044 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e] added Jun 26 02:51:47.038044 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:51:47.038044 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:51:47.038044 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:51:47.038044 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:51:47.038044 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:51:47.038044 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:47.038421 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:51:47.039287 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:51:47.039287 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:51:47.414917 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.430s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:51:47.414917 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] starting restore of backup volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9 container: tempest-volumesbackupstest-backup-container-859090827, to new volume 5bb5dab9-5479-4cad-9f07-38e52dc32ee3, backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9. {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jun 26 02:51:47.414917 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-859090827, metadata filename: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9_metadata. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jun 26 02:51:47.411801 np0000003683 sudo[144503]: pam_unix(sudo:session): session closed for user root Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] _read_metadata finished. Metadata: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "backup_description": null, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "backup_id": "7addc0a1-2cd8-4ab2-9778-17721e2a28e9", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "backup_name": "tempest-VolumesBackupsTest-Backup-225240867", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "created_at": "2026-06-26 02:51:18+00:00", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "objects": [ Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00001": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "82571f7121cb9475563edde615e4e4df", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 0 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00002": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 52428800 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00003": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "a35891500449df17e893f84bd88472fb", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 104857600 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00004": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 157286400 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00005": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 209715200 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00006": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 262144000 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00007": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 314572800 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00008": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 367001600 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00009": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 419430400 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00010": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 471859200 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00011": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 524288000 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00012": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 576716800 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00013": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 629145600 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00014": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 681574400 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00015": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 734003200 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00016": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 786432000 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00017": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 838860800 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00018": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 891289600 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00019": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 943718400 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00020": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 996147200 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00021": { Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "length": 25165824, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "offset": 1048576000 Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: ], Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "parent_id": null, Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "version": "1.0.0", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_id": "e876102a-9311-44e0-a8aa-8128f39b45ec", Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"e876102a-9311-44e0-a8aa-8128f39b45ec\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"3f08f0507eec40189b858129b4cc7fd1\", \"project_id\": \"c05f689c58a04254b3930f0cc279148c\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000003683@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-06-26T02:51:17.000000\", \"launched_at\": \"2026-06-26T02:51:17.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-958621306\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"268cd356-e153-49dd-857f-2ea5794ac5be\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"26cf225a-ef51-42c6-990c-f9523cca3d45\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-06-26T02:51:17.000000\", \"updated_at\": \"2026-06-26T02:51:18.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"eb0918cd-17b7-4dc6-8a46-002286996c07\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jun 26 02:51:47.654115 np0000003683 cinder-backup[101221]: }. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jun 26 02:51:47.657286 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Restoring backup version 1.0.0 {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jun 26 02:51:47.657286 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-859090827, metadata filename: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9_metadata. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] _read_metadata finished. Metadata: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "backup_description": null, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "backup_id": "7addc0a1-2cd8-4ab2-9778-17721e2a28e9", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "backup_name": "tempest-VolumesBackupsTest-Backup-225240867", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "created_at": "2026-06-26 02:51:18+00:00", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "objects": [ Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00001": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "82571f7121cb9475563edde615e4e4df", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 0 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00002": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 52428800 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00003": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "a35891500449df17e893f84bd88472fb", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 104857600 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00004": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 157286400 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00005": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 209715200 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00006": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 262144000 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00007": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 314572800 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00008": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 367001600 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00009": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 419430400 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00010": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 471859200 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00011": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 524288000 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00012": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 576716800 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00013": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 629145600 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00014": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 681574400 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00015": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 734003200 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00016": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 786432000 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00017": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 838860800 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00018": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 891289600 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00019": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 943718400 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00020": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 996147200 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00021": { Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "length": 25165824, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "offset": 1048576000 Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: } Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: ], Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "parent_id": null, Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "version": "1.0.0", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_id": "e876102a-9311-44e0-a8aa-8128f39b45ec", Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"e876102a-9311-44e0-a8aa-8128f39b45ec\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"3f08f0507eec40189b858129b4cc7fd1\", \"project_id\": \"c05f689c58a04254b3930f0cc279148c\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000003683@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-06-26T02:51:17.000000\", \"launched_at\": \"2026-06-26T02:51:17.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-958621306\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"268cd356-e153-49dd-857f-2ea5794ac5be\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"26cf225a-ef51-42c6-990c-f9523cca3d45\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-06-26T02:51:17.000000\", \"updated_at\": \"2026-06-26T02:51:18.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"eb0918cd-17b7-4dc6-8a46-002286996c07\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jun 26 02:51:47.683766 np0000003683 cinder-backup[101221]: }. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jun 26 02:51:47.688538 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] v1 volume backup restore of 7addc0a1-2cd8-4ab2-9778-17721e2a28e9 started. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jun 26 02:51:47.688538 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] metadata_object_names = ['volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00001', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00002', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00003', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00004', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00005', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00006', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00007', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00008', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00009', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00010', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00011', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00012', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00013', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00014', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00015', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00016', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00017', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00018', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00019', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00020', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00021']. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jun 26 02:51:47.732257 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] generated object list: ['volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00001', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00002', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00003', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00004', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00005', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00006', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00007', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00008', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00009', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00010', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00011', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00012', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00013', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00014', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00015', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00016', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00017', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00018', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00019', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00020', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00021', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9_metadata', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:51:47.771211 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:51:47.777118 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00001, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:47.901975 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:48.040436 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:51:48.088301 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:48.100786 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:48.129510 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:48.129510 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:48.129510 np0000003683 cinder-backup[101221]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:51:48.129510 np0000003683 cinder-backup[101221]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:51:48.129510 np0000003683 cinder-backup[101221]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash) Jun 26 02:51:48.129510 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:48.129510 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:48.129510 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:48.130356 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:48.130356 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:48.130356 np0000003683 cinder-backup[101221]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:51:48.130356 np0000003683 cinder-backup[101221]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:51:48.130356 np0000003683 cinder-backup[101221]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash) Jun 26 02:51:48.130356 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:48.130356 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:48.130356 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:48.179336 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e, portal: 192.168.40.100,3260] Jun 26 02:51:48.179336 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e, portal: 192.168.40.100,3260] successful. Jun 26 02:51:48.179336 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:48.196325 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:48.214517 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:48.214517 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:48.214517 np0000003683 cinder-backup[101221]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:51:48.214517 np0000003683 cinder-backup[101221]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:51:48.214517 np0000003683 cinder-backup[101221]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash) Jun 26 02:51:48.214517 np0000003683 cinder-backup[101221]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash) Jun 26 02:51:48.214517 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:48.214517 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:48.214517 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:48.214893 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:48.214893 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:48.214893 np0000003683 cinder-backup[101221]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:51:48.214893 np0000003683 cinder-backup[101221]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:51:48.214893 np0000003683 cinder-backup[101221]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash) Jun 26 02:51:48.214893 np0000003683 cinder-backup[101221]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash) Jun 26 02:51:48.214893 np0000003683 cinder-backup[101221]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:48.214893 np0000003683 cinder-backup[101221]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e72eb2-642a-4440-b292-3986774c1094 (non-flash) Jun 26 02:51:48.214893 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:48.215120 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:48.215120 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:51:48.217397 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] HCTL ('14', '-', '-', 0) found on session 139 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:51:48.217397 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Scanning host 14 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:51:48.241182 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Searching for a device in session 139 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:51:48.241182 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d0809e-e4dd-4708-a87a-8a4521f5cd3e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:51:48.522377 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00002, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:48.542753 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:48.942082 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00003, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:48.972285 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:49.349133 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.356s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:49.349496 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] <== connect_volume: return (3176ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799092', 'path': '/dev/sdi'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:49.349768 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:49.373858 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00004, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:49.379125 np0000003683 sudo[144565]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi Jun 26 02:51:49.380065 np0000003683 sudo[144565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:51:49.443348 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:49.724625 np0000003683 sudo[144565]: pam_unix(sudo:session): session closed for user root Jun 26 02:51:49.794074 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi" returned: 0 in 0.444s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:51:49.833231 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] _create_container started, container: volumebackups,backup: 44dab896-8087-41c6-a469-aad465cc8858. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:51:49.847980 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00005, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:49.881526 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:49.886697 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] generate_object_name_prefix: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858 {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:51:49.896699 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] starting backup of volume: e1eb4a88-5b8e-4127-8541-38317a84040d, volume size: 1073741824, object names prefix volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:51:50.254857 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00006, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:50.273377 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:50.299732 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:50.663700 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:50.664062 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:50.670925 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00007, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:50.695495 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:50.782327 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:50.782670 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:51.066019 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00008, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:51.095111 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:51.109889 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:51.446931 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:51.447096 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:51.459321 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00009, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:51.479844 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:51.682373 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:51.682373 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:51.833354 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00010, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:51.858312 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:52.242932 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00011, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:52.268855 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:52.288027 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:52.641082 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:52.641977 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:52.651579 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00012, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:52.672183 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:52.745053 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:52.745513 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:53.029572 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00013, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:53.054337 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:53.074084 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:53.395990 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:53.395990 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:53.404437 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00014, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:53.418710 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:53.514834 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:53.515093 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:53.800274 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00015, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:53.822424 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:53.851186 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:54.182877 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:54.183185 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:54.190387 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00016, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:54.211427 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:54.328057 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:54.328057 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:54.583502 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00017, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:54.599725 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:54.648708 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:54.975925 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:54.976415 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:54.982797 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00018, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:55.011597 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:55.098988 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:55.099221 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:55.407846 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00019, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:55.430307 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:55.443746 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:55.797123 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:55.797271 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:55.801781 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00020, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:55.825947 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:55.954433 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:55.954433 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:56.215008 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, object name: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00021, volume: 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:51:56.231991 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:51:56.260351 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:56.406435 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] v1 volume backup restore of 7addc0a1-2cd8-4ab2-9778-17721e2a28e9 finished. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jun 26 02:51:56.406722 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Restoring volume base metadata {{(pid=101221) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jun 26 02:51:56.416918 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] No metadata of type 'volume-metadata' to restore {{(pid=101221) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jun 26 02:51:56.417051 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Restoring volume glance metadata {{(pid=101221) _restore_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:258}} Jun 26 02:51:56.515702 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:56.515843 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:56.534656 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] restore 7addc0a1-2cd8-4ab2-9778-17721e2a28e9 to 5bb5dab9-5479-4cad-9f07-38e52dc32ee3 finished. {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jun 26 02:51:56.544260 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:51:56.566588 np0000003683 sudo[144793]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jun 26 02:51:56.567301 np0000003683 sudo[144793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:51:56.643882 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:56.644175 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:56.842568 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:56.918567 np0000003683 sudo[144793]: pam_unix(sudo:session): session closed for user root Jun 26 02:51:56.920496 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.376s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:51:56.921078 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5bb5dab9-5479-4cad-9f07-38e52dc32ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000e43a14eb', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:51:56.921332 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:51:56.921802 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:51:56.922226 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5bb5dab9-5479-4cad-9f07-38e52dc32ee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56 Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:51:56.934321 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:51:56.935033 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:51:56.963186 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:56.963186 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:56.963186 np0000003683 cinder-backup[101221]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash) Jun 26 02:51:56.963186 np0000003683 cinder-backup[101221]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash) Jun 26 02:51:56.963186 np0000003683 cinder-backup[101221]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56 (non-flash) Jun 26 02:51:56.963186 np0000003683 cinder-backup[101221]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56 (non-flash) Jun 26 02:51:56.963186 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:51:56.963521 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:56.963521 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:51:56.963521 np0000003683 cinder-backup[101221]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3 (non-flash) Jun 26 02:51:56.963521 np0000003683 cinder-backup[101221]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash) Jun 26 02:51:56.963521 np0000003683 cinder-backup[101221]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56 (non-flash) Jun 26 02:51:56.963521 np0000003683 cinder-backup[101221]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56 (non-flash) Jun 26 02:51:56.963521 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:51:56.963722 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e', '139'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', '140'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-60f7f564-2c89-4c17-bc68-049bc6019b56', '141')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:51:56.963924 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3', '138')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:51:56.965243 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Resulting device map defaultdict(. at 0x79db5a24c4a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3'): ({'sdh'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:51:56.965621 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Removing single pathed devices sdh {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:51:56.978544 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Flushing IO for device /dev/sdh {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:51:56.987401 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:51:57.039555 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:51:57.039801 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] SCSI volumes sdh have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:51:57.040858 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:51:57.055682 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:51:57.056112 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:51:57.070088 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:57.091284 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:57.092659 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:57.105431 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 138, target: iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3, portal: 192.168.40.100,3260] Jun 26 02:51:57.105431 np0000003683 cinder-backup[101221]: Logout of [sid: 138, target: iqn.2023-03.storpool.com:os--volume-5bb5dab9-5479-4cad-9f07-38e52dc32ee3, portal: 192.168.40.100,3260] successful. Jun 26 02:51:57.105431 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:57.126242 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:51:57.127369 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.205s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:51:57.127369 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] <== disconnect_volume: return (205ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:51:57.222690 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:57.223183 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:57.406997 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:57.657007 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:57.657215 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:57.766693 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:57.766863 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:57.978877 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:58.145322 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.manager [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Encryption key ID for volume 5bb5dab9-5479-4cad-9f07-38e52dc32ee3 already matches encryption key ID in backup 7addc0a1-2cd8-4ab2-9778-17721e2a28e9. {{(pid=101221) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jun 26 02:51:58.178392 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-8eace4a6-1644-42e9-8c47-341bac4ab17c tempest-VolumesBackupsTest-1738581805 None] Finished restoring backup 7addc0a1-2cd8-4ab2-9778-17721e2a28e9 to volume 5bb5dab9-5479-4cad-9f07-38e52dc32ee3. Jun 26 02:51:58.229957 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:58.230321 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:58.336675 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:58.336675 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:58.592654 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:58.843657 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:58.843846 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:58.948865 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:58.949076 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:59.145603 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:59.420320 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:51:59.420877 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:51:59.535694 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:51:59.535694 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:51:59.585428 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] Delete backup started, backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9. Jun 26 02:51:59.593207 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_c05f689c58a04254b3930f0cc279148c {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:51:59.593611 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:51:59.593826 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] delete started, backup: 7addc0a1-2cd8-4ab2-9778-17721e2a28e9, container: tempest-volumesbackupstest-backup-container-859090827, prefix: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:51:59.641542 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] generated object list: ['volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00001', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00002', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00003', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00004', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00005', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00006', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00007', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00008', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00009', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00010', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00011', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00012', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00013', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00014', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00015', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00016', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00017', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00018', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00019', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00020', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00021', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9_metadata', 'volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:51:59.673466 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00001 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:59.703530 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00002 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:59.736950 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00003 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:59.764469 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:51:59.770864 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00004 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:59.797318 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00005 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:59.820342 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00006 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:59.842768 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00007 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:59.869790 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00008 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:59.893316 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00009 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:59.916430 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00010 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:59.937778 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00011 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:51:59.973015 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00012 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:00.006868 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00013 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:00.026890 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00014 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:00.035916 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:00.036140 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:00.050038 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00015 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:00.071848 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00016 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:00.093706 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00017 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:00.116036 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00018 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:00.141204 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00019 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:00.148604 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:00.149537 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:00.185378 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00020 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:00.195972 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:52:00.220915 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9-00021 in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:00.257691 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9_metadata in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:00.289845 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_e876102a-9311-44e0-a8aa-8128f39b45ec/20260626025121/az_nova_backup_7addc0a1-2cd8-4ab2-9778-17721e2a28e9_sha256file in container: tempest-volumesbackupstest-backup-container-859090827. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:00.290135 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] delete 7addc0a1-2cd8-4ab2-9778-17721e2a28e9 finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:52:00.309875 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] Created reservations ['e3f00d79-d67b-4a48-8b28-daf46c69035c', '3c81d06e-fa79-44f4-9c3d-082f066d645b'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:52:00.343290 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-ed1bc56e-780d-4128-a300-ce9c0bf12864 tempest-VolumesBackupsTest-1738581805 None] Delete backup finished, backup 7addc0a1-2cd8-4ab2-9778-17721e2a28e9 deleted. Jun 26 02:52:00.412185 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:00.661788 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:00.662197 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:00.775085 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:00.775359 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:01.004424 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:01.283110 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:01.283336 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:01.401624 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:01.401806 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:01.613091 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:01.869372 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:01.869372 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:01.999666 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:01.999666 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:02.237265 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:02.491970 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:02.492194 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:02.613860 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:02.614126 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:02.925912 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:03.189239 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:03.189468 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:03.323104 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:03.323399 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:03.345034 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Create backup started, backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f volume: 9d93b15d-1b4c-40d6-b77d-44ed1be47f76. Jun 26 02:52:03.357277 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-1443096218',created_at=2026-06-26T02:52:03Z,data_timestamp=2026-06-26T02:52:03Z,deleted=False,deleted_at=None,display_description='tempest-backup-description-777566042',display_name='tempest-VolumesBackupsTest-Backup-1733843151',encryption_key_id=None,fail_reason=None,host='np0000003683',id=6d36fbc8-4c25-4616-83ca-87496d3f851f,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c05f689c58a04254b3930f0cc279148c',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3f08f0507eec40189b858129b4cc7fd1',volume_id=9d93b15d-1b4c-40d6-b77d-44ed1be47f76) Jun 26 02:52:03.388819 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_c05f689c58a04254b3930f0cc279148c {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:52:03.389034 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:52:03.389467 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:52:03.402439 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:52:03.436793 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:52:03.460122 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:52:03.460715 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:52:03.471998 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:52:03.473037 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe58:ad7f', 'fe80::74de:4eff:fe49:517', 'fe80::fc16:3eff:feb3:3a57', 'fe80::ec24:c8ff:fe51:231f'] Jun 26 02:52:03.473196 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:52:03.473364 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:52:03.474882 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:52:03.701357 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:03.969574 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:03.969902 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:03.980872 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:52:03.981416 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d93b15d-1b4c-40d6-b77d-44ed1be47f76', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:52:03.981693 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:52:03.982754 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:52:03.983352 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d93b15d-1b4c-40d6-b77d-44ed1be47f76', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:52:03.999495 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:52:04.000016 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:52:04.000469 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:52:04.015555 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:52:04.015555 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:04.031641 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76] added Jun 26 02:52:04.031641 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:52:04.031641 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:52:04.031641 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:52:04.031641 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:52:04.031641 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:52:04.031641 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:04.031986 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:52:04.032505 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:52:04.032713 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:52:04.130663 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:04.130868 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:04.196227 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:52:04.358303 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:04.477212 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:04.477441 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:04.544583 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup MD5 for volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:04.544755 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:04.556160 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:52:04.565771 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:52:04.565771 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:52:04.578931 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:52:04.578931 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:52:04.585065 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:52:04.585363 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:52:04.676619 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:52:04.677786 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] _write_metadata started, container name: volumebackups, metadata filename: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:52:04.709826 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "44dab896-8087-41c6-a469-aad465cc8858",\n "backup_name": "tempest-VolumesBackupsTest-Backup-411834455",\n "created_at": "2026-06-26 02:51:45+00:00",\n "objects": [\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "e1eb4a88-5b8e-4127-8541-38317a84040d",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"e1eb4a88-5b8e-4127-8541-38317a84040d\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"6abcc90720de4d3e8d49aa5c4bb02b11\\", \\"project_id\\": \\"7a0a7fdd73fc40328c4c73ef53edc697\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"available\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:51:43.000000\\", \\"launched_at\\": \\"2026-06-26T02:51:43.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-464143299\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": null, \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:51:43.000000\\", \\"updated_at\\": \\"2026-06-26T02:51:43.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:52:04.730083 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] backup 44dab896-8087-41c6-a469-aad465cc8858 finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:52:04.871762 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:52:04.894131 np0000003683 sudo[145100]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi Jun 26 02:52:04.894872 np0000003683 sudo[145100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:52:05.035220 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:52:05.047105 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:05.059245 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:05.075993 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:52:05.075993 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:52:05.075993 np0000003683 cinder-backup[101221]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash) Jun 26 02:52:05.075993 np0000003683 cinder-backup[101221]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:52:05.075993 np0000003683 cinder-backup[101221]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:52:05.075993 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:52:05.075993 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:52:05.075993 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:52:05.075993 np0000003683 cinder-backup[101221]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash) Jun 26 02:52:05.075993 np0000003683 cinder-backup[101221]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:52:05.075993 np0000003683 cinder-backup[101221]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:52:05.075993 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:52:05.113387 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76, portal: 192.168.40.100,3260] Jun 26 02:52:05.113387 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76, portal: 192.168.40.100,3260] successful. Jun 26 02:52:05.113387 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:05.124905 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:05.139774 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:52:05.139774 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:52:05.139774 np0000003683 cinder-backup[101221]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash) Jun 26 02:52:05.139774 np0000003683 cinder-backup[101221]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:52:05.139774 np0000003683 cinder-backup[101221]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:52:05.139774 np0000003683 cinder-backup[101221]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76 (non-flash) Jun 26 02:52:05.139774 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:52:05.139774 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:52:05.139774 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:52:05.139774 np0000003683 cinder-backup[101221]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash) Jun 26 02:52:05.139774 np0000003683 cinder-backup[101221]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:52:05.139774 np0000003683 cinder-backup[101221]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:52:05.139774 np0000003683 cinder-backup[101221]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76 (non-flash) Jun 26 02:52:05.139774 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:52:05.140636 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:52:05.140636 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:52:05.141755 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] HCTL ('11', '-', '-', 0) found on session 144 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:52:05.142231 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Scanning host 11 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:52:05.165017 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Searching for a device in session 144 and hctl ['11', '*', '*', 0] yield: None {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:52:05.281334 np0000003683 sudo[145100]: pam_unix(sudo:session): session closed for user root Jun 26 02:52:05.283331 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi" returned: 0 in 0.412s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:52:05.283979 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d0809e-e4dd-4708-a87a-8a4521f5cd3e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799092', 'path': '/dev/sdi'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:52:05.284210 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:52:06.166568 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Searching for a device in session 144 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:52:06.167108 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d93b15d-1b4c-40d6-b77d-44ed1be47f76', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:52:06.167621 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.185s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:52:06.167820 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] <== connect_volume: return (2186ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799101', 'path': '/dev/sdf'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:52:06.168182 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:52:06.174974 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.890s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:52:06.175848 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d0809e-e4dd-4708-a87a-8a4521f5cd3e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76 Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:52:06.186503 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:52:06.187314 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:52:06.187314 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:52:06.187314 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:52:06.187314 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:52:06.186505 np0000003683 sudo[145154]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf Jun 26 02:52:06.187270 np0000003683 sudo[145154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:52:06.212763 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:52:06.212763 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:52:06.212763 np0000003683 cinder-backup[101221]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash) Jun 26 02:52:06.212763 np0000003683 cinder-backup[101221]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:52:06.212763 np0000003683 cinder-backup[101221]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:52:06.212763 np0000003683 cinder-backup[101221]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76 (non-flash) Jun 26 02:52:06.212763 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:52:06.212763 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:52:06.212763 np0000003683 cinder-backup[101221]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52 (non-flash) Jun 26 02:52:06.212763 np0000003683 cinder-backup[101221]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e (non-flash) Jun 26 02:52:06.212763 np0000003683 cinder-backup[101221]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:52:06.212763 np0000003683 cinder-backup[101221]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599 (non-flash) Jun 26 02:52:06.212763 np0000003683 cinder-backup[101221]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76 (non-flash) Jun 26 02:52:06.212763 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:52:06.213174 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f3c44af-e4df-4708-b764-ffe26cbedf52', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9011c234-a216-45df-a8b6-11d10db8e599', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76', '144')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:52:06.213301 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e', '139')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:52:06.214641 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Resulting device map defaultdict(. at 0x79db5a8234c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e'): ({'sdi'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:52:06.214986 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Removing single pathed devices sdi {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:52:06.225907 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Flushing IO for device /dev/sdi {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:52:06.234331 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:52:06.280290 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Checking to see if SCSI volumes sdi have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:52:06.280462 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] SCSI volumes sdi have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:52:06.282028 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Checking to see if device paths {'sdi'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:52:06.292091 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Device paths {'sdi'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:52:06.292496 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:52:06.305411 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:06.338911 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 139, target: iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e, portal: 192.168.40.100,3260] Jun 26 02:52:06.338911 np0000003683 cinder-backup[101221]: Logout of [sid: 139, target: iqn.2023-03.storpool.com:os--volume-90d0809e-e4dd-4708-a87a-8a4521f5cd3e, portal: 192.168.40.100,3260] successful. Jun 26 02:52:06.338911 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:06.357118 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:06.357586 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.184s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:52:06.357760 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] <== disconnect_volume: return (1074ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:52:06.534438 np0000003683 sudo[145154]: pam_unix(sudo:session): session closed for user root Jun 26 02:52:06.543560 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf" returned: 0 in 0.370s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:52:06.549442 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] _create_container started, container: tempest-volumesbackupstest-backup-container-1443096218,backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:52:06.602987 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] generate_object_name_prefix: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:52:06.612003 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] starting backup of volume: 9d93b15d-1b4c-40d6-b77d-44ed1be47f76, volume size: 1073741824, object names prefix volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:52:06.846861 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:07.098025 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:07.098025 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:07.219648 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:07.220140 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:07.395129 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-1a593cd2-4bf9-44ce-b8b6-5d4e29795a70 tempest-VolumesBackupsTest-232973889 None] Create backup finished. backup: 44dab896-8087-41c6-a469-aad465cc8858. Jun 26 02:52:07.422672 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:07.667459 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:07.667686 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:07.774752 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:07.774935 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:07.965133 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:08.137465 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] Delete backup started, backup: 44dab896-8087-41c6-a469-aad465cc8858. Jun 26 02:52:08.144437 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_7a0a7fdd73fc40328c4c73ef53edc697 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:52:08.145115 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:52:08.145645 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] delete started, backup: 44dab896-8087-41c6-a469-aad465cc8858, container: volumebackups, prefix: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:52:08.205941 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] generated object list: ['volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00001', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00002', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00003', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00004', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00005', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00006', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00007', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00008', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00009', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00010', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00011', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00012', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00013', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00014', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00015', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00016', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00017', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00018', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00019', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00020', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00021', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858_metadata', 'volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:52:08.234650 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00001 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.243430 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:08.243722 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:08.260366 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00002 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.288055 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00003 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.312250 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00004 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.337739 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00005 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.360569 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00006 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.364596 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:08.364864 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:08.410977 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:52:08.425768 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00007 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.475945 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00008 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.504933 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00009 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.540392 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00010 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.578596 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00011 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.604264 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00012 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.615851 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:08.629824 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00013 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.650796 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00014 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.673688 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00015 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.697427 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00016 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.725595 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00017 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.753132 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00018 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.779797 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00019 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.806700 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00020 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.827439 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858-00021 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.854947 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858_metadata in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.878978 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:08.879358 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:08.881922 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] deleted object: volume_e1eb4a88-5b8e-4127-8541-38317a84040d/20260626025149/az_nova_backup_44dab896-8087-41c6-a469-aad465cc8858_sha256file in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:08.882109 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] delete 44dab896-8087-41c6-a469-aad465cc8858 finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:52:08.912486 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] Created reservations ['f796b5be-b596-46b0-b967-f59e92191e86', '376176b6-afad-404e-bcac-c9d15fbca965'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:52:08.949295 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-7bb7eb55-c4cd-4a06-b67d-ba7ac5350844 tempest-VolumesBackupsTest-232973889 None] Delete backup finished, backup 44dab896-8087-41c6-a469-aad465cc8858 deleted. Jun 26 02:52:08.994855 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:08.994929 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:09.225285 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:09.480812 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:09.481192 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:09.588934 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:09.589105 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:09.789529 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:10.088052 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:10.088729 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:10.195561 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:10.195766 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:10.447009 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:10.704040 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:10.704040 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:10.838213 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:10.838416 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:11.041078 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:11.307252 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:11.307381 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:11.422597 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:11.423116 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:11.681944 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:11.953407 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:11.953407 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:12.082396 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:12.082396 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:12.297648 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:12.558189 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:12.558189 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:12.688928 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:12.689065 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:12.698899 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:52:12.698899 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:52:12.887242 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:13.147680 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:13.147988 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:13.282262 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:13.282489 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:13.500772 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:13.770685 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:13.770847 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:13.888632 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:13.888632 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:14.102621 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:14.354296 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:14.354296 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:14.464116 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:14.464298 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:14.661788 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:14.904923 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:14.905089 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:15.025455 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:15.025640 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:15.268068 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:15.508135 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:15.508135 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:15.627970 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:15.628227 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:15.913205 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:16.166462 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:16.166683 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:16.279694 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:16.280196 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:16.497607 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:16.758961 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:16.759335 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:16.880892 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:16.880892 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:17.102320 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:17.349237 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:17.349437 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:17.471445 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:17.471669 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:17.714565 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:17.966693 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:17.967132 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:18.072427 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:18.072579 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:18.280609 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:18.527962 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:18.528267 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:18.651268 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:18.651418 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:18.813681 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:52:18.939000 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:52:18.939183 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:52:19.019118 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:52:19.019628 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:52:19.030443 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:52:19.038151 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:52:19.038423 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:52:19.043696 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Completed fetching metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:121}} Jun 26 02:52:19.043696 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:52:19.049611 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:52:19.049994 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-1443096218, sha256file filename: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:52:19.136774 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:52:19.138460 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-1443096218, metadata filename: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:52:19.168808 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] _write_metadata finished. Metadata: b'{\n "backup_description": "tempest-backup-description-777566042",\n "backup_id": "6d36fbc8-4c25-4616-83ca-87496d3f851f",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1733843151",\n "created_at": "2026-06-26 02:52:03+00:00",\n "objects": [\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "9d93b15d-1b4c-40d6-b77d-44ed1be47f76",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"9d93b15d-1b4c-40d6-b77d-44ed1be47f76\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"3f08f0507eec40189b858129b4cc7fd1\\", \\"project_id\\": \\"c05f689c58a04254b3930f0cc279148c\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:52:02.000000\\", \\"launched_at\\": \\"2026-06-26T02:52:02.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-299090623\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:52:02.000000\\", \\"updated_at\\": \\"2026-06-26T02:52:03.000000\\"}, \\"volume-metadata\\": {\\"vol-meta1\\": \\"value1\\", \\"vol-meta2\\": \\"value2\\", \\"vol-meta3\\": \\"value3\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:52:19.176232 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] backup 6d36fbc8-4c25-4616-83ca-87496d3f851f finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:52:19.310003 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:52:19.341155 np0000003683 sudo[145669]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf Jun 26 02:52:19.341773 np0000003683 sudo[145669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:52:19.683098 np0000003683 sudo[145669]: pam_unix(sudo:session): session closed for user root Jun 26 02:52:19.685669 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf" returned: 0 in 0.375s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:52:19.687065 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d93b15d-1b4c-40d6-b77d-44ed1be47f76', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799101', 'path': '/dev/sdf'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:52:19.687065 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:52:19.688286 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:52:19.688764 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d93b15d-1b4c-40d6-b77d-44ed1be47f76', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:52:19.700310 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:52:19.700310 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:52:19.700310 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:52:19.700310 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:52:19.700310 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:52:19.700310 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76 Jun 26 02:52:19.700310 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:52:19.700310 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:52:19.700310 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:52:19.700310 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:52:19.700310 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:52:19.700310 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:52:19.700310 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:52:19.700310 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:52:19.700707 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:52:19.723492 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76 (non-flash) Jun 26 02:52:19.723492 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:52:19.723746 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76 (non-flash) Jun 26 02:52:19.723746 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:52:19.723958 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76', '144')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:52:19.724261 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76', '144')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:52:19.725028 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Resulting device map defaultdict(. at 0x79db5a8702c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76'): ({'sdf'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:52:19.725245 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Removing single pathed devices sdf {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:52:19.736733 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Flushing IO for device /dev/sdf {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:52:19.746026 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:52:19.794232 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Checking to see if SCSI volumes sdf have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:52:19.794461 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] SCSI volumes sdf have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:52:19.795574 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Checking to see if device paths {'sdf'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:52:19.808035 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Device paths {'sdf'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:52:19.808387 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:52:19.823565 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:19.855873 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 144, target: iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76, portal: 192.168.40.100,3260] Jun 26 02:52:19.855873 np0000003683 cinder-backup[101221]: Logout of [sid: 144, target: iqn.2023-03.storpool.com:os--volume-9d93b15d-1b4c-40d6-b77d-44ed1be47f76, portal: 192.168.40.100,3260] successful. Jun 26 02:52:19.855873 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:19.868908 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:19.868908 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.180s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:52:19.868908 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] <== disconnect_volume: return (181ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:52:20.906332 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-6c01dc4e-908c-442e-a4ea-32ddddb1cb04 tempest-VolumesBackupsTest-1738581805 None] Create backup finished. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f. Jun 26 02:52:23.175448 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Restore backup started, backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. Jun 26 02:52:23.179305 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=284,cinder:UPDATE=89,cinder:INSERT=31 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:52:23.194053 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_c05f689c58a04254b3930f0cc279148c {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:52:23.194692 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:52:23.195125 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:52:23.205440 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:52:23.226262 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:52:23.241610 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:52:23.242147 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:52:23.248900 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:52:23.249872 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:feb3:3a57', 'fe80::ec24:c8ff:fe51:231f'] Jun 26 02:52:23.250049 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:52:23.250233 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:52:23.250546 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:52:24.258548 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:52:24.259120 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8af9506c-18b2-4f35-a5fc-ea9645eaf8b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:52:24.259244 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:52:24.259764 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:52:24.260017 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8af9506c-18b2-4f35-a5fc-ea9645eaf8b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:52:24.272543 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:52:24.273090 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:52:24.273402 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:52:24.284245 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:52:24.284245 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:24.294404 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6] added Jun 26 02:52:24.294404 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:52:24.294404 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:52:24.294404 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:52:24.294404 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:52:24.294404 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:52:24.294404 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:24.295500 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:52:24.295500 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0216(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:52:24.295500 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:52:25.296551 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:52:25.309731 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:25.321775 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:25.333190 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 26 02:52:25.333190 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:52:25.333387 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 26 02:52:25.333387 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:52:25.333505 np0000003683 cinder-backup[101221]: WARNING os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 26 02:52:25.333505 np0000003683 cinder-backup[101221]: Jun 26 02:52:25.360429 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6, portal: 192.168.40.100,3260] Jun 26 02:52:25.360429 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6, portal: 192.168.40.100,3260] successful. Jun 26 02:52:25.360429 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:25.374559 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:25.385409 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6 (non-flash) Jun 26 02:52:25.385409 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:52:25.385641 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6 (non-flash) Jun 26 02:52:25.385641 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:52:25.386042 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.113s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:52:25.386276 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:52:25.386853 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] HCTL ('7', '-', '-', 0) found on session 147 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:52:25.387062 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:52:25.400658 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Searching for a device in session 147 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:52:25.400658 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8af9506c-18b2-4f35-a5fc-ea9645eaf8b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:52:26.401951 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.142s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:52:26.402303 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] <== connect_volume: return (2142ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799116', 'path': '/dev/sdb'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:52:26.402557 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:52:26.420059 np0000003683 sudo[145783]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jun 26 02:52:26.423291 np0000003683 sudo[145783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:52:26.787015 np0000003683 sudo[145783]: pam_unix(sudo:session): session closed for user root Jun 26 02:52:26.789087 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.386s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:52:26.789506 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] starting restore of backup volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f container: tempest-volumesbackupstest-backup-container-1443096218, to new volume 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6, backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f. {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jun 26 02:52:26.789624 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-1443096218, metadata filename: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f_metadata. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] _read_metadata finished. Metadata: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "backup_description": "tempest-backup-description-777566042", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "backup_id": "6d36fbc8-4c25-4616-83ca-87496d3f851f", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "backup_name": "tempest-VolumesBackupsTest-Backup-1733843151", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "created_at": "2026-06-26 02:52:03+00:00", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "objects": [ Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00001": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 0 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00002": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 52428800 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00003": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 104857600 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00004": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 157286400 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00005": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 209715200 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00006": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 262144000 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00007": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 314572800 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00008": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 367001600 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00009": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 419430400 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00010": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 471859200 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00011": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 524288000 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00012": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 576716800 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00013": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 629145600 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00014": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 681574400 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00015": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 734003200 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00016": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 786432000 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00017": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 838860800 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00018": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 891289600 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00019": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 943718400 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00020": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 996147200 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00021": { Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "length": 25165824, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "offset": 1048576000 Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: ], Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "parent_id": null, Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "version": "1.0.0", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_id": "9d93b15d-1b4c-40d6-b77d-44ed1be47f76", Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"9d93b15d-1b4c-40d6-b77d-44ed1be47f76\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"3f08f0507eec40189b858129b4cc7fd1\", \"project_id\": \"c05f689c58a04254b3930f0cc279148c\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000003683@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-06-26T02:52:02.000000\", \"launched_at\": \"2026-06-26T02:52:02.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-299090623\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"268cd356-e153-49dd-857f-2ea5794ac5be\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"26cf225a-ef51-42c6-990c-f9523cca3d45\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-06-26T02:52:02.000000\", \"updated_at\": \"2026-06-26T02:52:03.000000\"}, \"volume-metadata\": {\"vol-meta1\": \"value1\", \"vol-meta2\": \"value2\", \"vol-meta3\": \"value3\"}}" Jun 26 02:52:26.807769 np0000003683 cinder-backup[101221]: }. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jun 26 02:52:26.811905 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Restoring backup version 1.0.0 {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jun 26 02:52:26.811905 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-1443096218, metadata filename: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f_metadata. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] _read_metadata finished. Metadata: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "backup_description": "tempest-backup-description-777566042", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "backup_id": "6d36fbc8-4c25-4616-83ca-87496d3f851f", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "backup_name": "tempest-VolumesBackupsTest-Backup-1733843151", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "created_at": "2026-06-26 02:52:03+00:00", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "objects": [ Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00001": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 0 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00002": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 52428800 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00003": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 104857600 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00004": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 157286400 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00005": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 209715200 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00006": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 262144000 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00007": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 314572800 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00008": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 367001600 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00009": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 419430400 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00010": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 471859200 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00011": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 524288000 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00012": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 576716800 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00013": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 629145600 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00014": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 681574400 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00015": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 734003200 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00016": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 786432000 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00017": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 838860800 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00018": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 891289600 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00019": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 943718400 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00020": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 996147200 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00021": { Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "length": 25165824, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "offset": 1048576000 Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: } Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: ], Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "parent_id": null, Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "version": "1.0.0", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_id": "9d93b15d-1b4c-40d6-b77d-44ed1be47f76", Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"9d93b15d-1b4c-40d6-b77d-44ed1be47f76\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"3f08f0507eec40189b858129b4cc7fd1\", \"project_id\": \"c05f689c58a04254b3930f0cc279148c\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000003683@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-06-26T02:52:02.000000\", \"launched_at\": \"2026-06-26T02:52:02.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-299090623\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"268cd356-e153-49dd-857f-2ea5794ac5be\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"26cf225a-ef51-42c6-990c-f9523cca3d45\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-06-26T02:52:02.000000\", \"updated_at\": \"2026-06-26T02:52:03.000000\"}, \"volume-metadata\": {\"vol-meta1\": \"value1\", \"vol-meta2\": \"value2\", \"vol-meta3\": \"value3\"}}" Jun 26 02:52:26.825408 np0000003683 cinder-backup[101221]: }. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jun 26 02:52:26.830164 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] v1 volume backup restore of 6d36fbc8-4c25-4616-83ca-87496d3f851f started. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jun 26 02:52:26.830164 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] metadata_object_names = ['volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00001', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00002', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00003', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00004', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00005', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00006', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00007', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00008', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00009', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00010', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00011', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00012', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00013', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00014', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00015', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00016', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00017', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00018', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00019', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00020', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00021']. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jun 26 02:52:26.866347 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] generated object list: ['volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00001', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00002', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00003', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00004', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00005', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00006', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00007', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00008', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00009', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00010', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00011', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00012', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00013', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00014', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00015', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00016', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00017', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00018', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00019', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00020', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00021', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f_metadata', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:52:26.906374 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:52:26.910873 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00001, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:26.924692 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:27.304608 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00002, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:27.320577 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:27.675929 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00003, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:27.695841 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:28.045789 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00004, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:28.060865 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:28.411380 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00005, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:28.433810 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:28.768698 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00006, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:28.783823 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:29.142405 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00007, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:29.159689 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:29.507796 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00008, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:29.524170 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:29.871943 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00009, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:29.889585 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:30.273952 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00010, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:30.293741 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:30.633623 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00011, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:30.651423 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:31.016549 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00012, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:31.047227 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:31.396303 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00013, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:31.413027 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:31.800240 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00014, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:31.817494 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:32.183268 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00015, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:32.198762 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:32.533827 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00016, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:32.550491 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:32.915496 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00017, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:32.931010 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:33.288618 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00018, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:33.306899 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:33.663566 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00019, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:33.687492 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:34.047609 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00020, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:34.065655 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:34.421718 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restoring object. backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, object name: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00021, volume: 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:52:34.443666 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:52:34.619528 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] v1 volume backup restore of 6d36fbc8-4c25-4616-83ca-87496d3f851f finished. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jun 26 02:52:34.619918 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Restoring volume base metadata {{(pid=101221) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jun 26 02:52:34.643970 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Restoring volume metadata {{(pid=101221) _restore_vol_meta /opt/stack/cinder/cinder/backup/driver.py:249}} Jun 26 02:52:34.666254 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101221) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jun 26 02:52:34.668341 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] restore 6d36fbc8-4c25-4616-83ca-87496d3f851f to 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6 finished. {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jun 26 02:52:34.668341 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:52:34.689305 np0000003683 sudo[145963]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jun 26 02:52:34.690053 np0000003683 sudo[145963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:52:35.078687 np0000003683 sudo[145963]: pam_unix(sudo:session): session closed for user root Jun 26 02:52:35.081295 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.414s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:52:35.082193 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8af9506c-18b2-4f35-a5fc-ea9645eaf8b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799116', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:52:35.082455 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:52:35.083298 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:52:35.083470 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8af9506c-18b2-4f35-a5fc-ea9645eaf8b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:52:35.093147 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:52:35.093147 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:52:35.093147 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:52:35.093147 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:52:35.093147 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:52:35.093147 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 Jun 26 02:52:35.093147 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:52:35.093147 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:52:35.093147 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:52:35.093147 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:52:35.093147 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6 Jun 26 02:52:35.093147 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:52:35.093147 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:52:35.093147 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:52:35.093147 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:52:35.093147 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:52:35.094257 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:52:35.094257 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:52:35.094257 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:52:35.094257 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:52:35.114335 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6 (non-flash) Jun 26 02:52:35.114335 np0000003683 cinder-backup[101221]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash) Jun 26 02:52:35.114335 np0000003683 cinder-backup[101221]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash) Jun 26 02:52:35.114335 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:52:35.114646 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6 (non-flash) Jun 26 02:52:35.114646 np0000003683 cinder-backup[101221]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash) Jun 26 02:52:35.114646 np0000003683 cinder-backup[101221]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334 (non-flash) Jun 26 02:52:35.114646 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:52:35.114793 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fed18f24-1d24-4ee5-9cdc-eb6eb0b8b334', '149')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:52:35.114922 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6', '147')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:52:35.115858 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Resulting device map defaultdict(. at 0x79db5a805260>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6'): ({'sdb'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:52:35.116062 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Removing single pathed devices sdb {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:52:35.126506 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Flushing IO for device /dev/sdb {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:52:35.133779 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:52:35.175948 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:52:35.176122 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] SCSI volumes sdb have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:52:35.176999 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:52:35.188019 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:52:35.188075 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:52:35.198673 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:35.230803 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 147, target: iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6, portal: 192.168.40.100,3260] Jun 26 02:52:35.230803 np0000003683 cinder-backup[101221]: Logout of [sid: 147, target: iqn.2023-03.storpool.com:os--volume-8af9506c-18b2-4f35-a5fc-ea9645eaf8b6, portal: 192.168.40.100,3260] successful. Jun 26 02:52:35.230803 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:35.244281 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:52:35.244652 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.162s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:52:35.244848 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] <== disconnect_volume: return (162ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:52:36.259164 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.manager [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Encryption key ID for volume 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6 already matches encryption key ID in backup 6d36fbc8-4c25-4616-83ca-87496d3f851f. {{(pid=101221) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jun 26 02:52:36.306034 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-e5d86b77-5646-4af7-a43e-bac5363fb1d6 tempest-VolumesBackupsTest-1738581805 None] Finished restoring backup 6d36fbc8-4c25-4616-83ca-87496d3f851f to volume 8af9506c-18b2-4f35-a5fc-ea9645eaf8b6. Jun 26 02:52:37.797676 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] Delete backup started, backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f. Jun 26 02:52:37.804071 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_c05f689c58a04254b3930f0cc279148c {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:52:37.804700 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:52:37.804982 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] delete started, backup: 6d36fbc8-4c25-4616-83ca-87496d3f851f, container: tempest-volumesbackupstest-backup-container-1443096218, prefix: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:52:37.850517 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] generated object list: ['volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00001', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00002', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00003', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00004', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00005', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00006', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00007', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00008', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00009', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00010', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00011', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00012', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00013', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00014', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00015', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00016', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00017', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00018', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00019', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00020', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00021', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f_metadata', 'volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:52:37.913720 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00001 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:37.949671 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00002 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:37.979734 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00003 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.003417 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00004 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.035553 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00005 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.077350 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00006 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.104413 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00007 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.133113 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00008 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.174338 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00009 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.203053 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00010 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.230670 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00011 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.255810 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00012 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.276578 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00013 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.304881 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00014 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.325944 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00015 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.351669 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00016 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.374486 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00017 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.398143 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00018 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.418675 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00019 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.454412 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00020 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.484925 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f-00021 in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.510044 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f_metadata in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.539596 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d93b15d-1b4c-40d6-b77d-44ed1be47f76/20260626025206/az_nova_backup_6d36fbc8-4c25-4616-83ca-87496d3f851f_sha256file in container: tempest-volumesbackupstest-backup-container-1443096218. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:52:38.539821 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] delete 6d36fbc8-4c25-4616-83ca-87496d3f851f finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:52:38.574449 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:52:38.609520 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] Created reservations ['6e58d106-a015-4926-9072-982ecc8de6f2', '7a420259-06d8-4037-8d3b-8a8236632d6f'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:52:38.650778 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-a157044e-dbb3-4e51-ac70-93ed760ecc60 tempest-VolumesBackupsTest-1738581805 None] Delete backup finished, backup 6d36fbc8-4c25-4616-83ca-87496d3f851f deleted. Jun 26 02:52:48.631514 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=36,cinder:UPDATE=10,cinder:INSERT=4 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:53:12.702213 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:53:12.702807 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:53:28.753390 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Create backup started, backup: 5fe20ba2-218d-490b-9118-b4aa6049677d volume: 7730da01-0f5e-4293-9e1c-5590aad808b1. Jun 26 02:53:28.762500 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupsadmintest-backup-container-1208463645',created_at=2026-06-26T02:53:28Z,data_timestamp=2026-06-26T02:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1075566652',encryption_key_id=None,fail_reason=None,host='np0000003683',id=5fe20ba2-218d-490b-9118-b4aa6049677d,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='114c0bf7bbc44628b0d55341c3995675',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f0457c70da9b425dbc2ac13bb2100173',volume_id=7730da01-0f5e-4293-9e1c-5590aad808b1) Jun 26 02:53:28.785048 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_114c0bf7bbc44628b0d55341c3995675 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:53:28.785318 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:53:28.785620 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:53:28.794835 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:53:28.812047 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:53:28.824399 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:53:28.824705 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:53:28.831652 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:53:28.832832 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1b:478e', 'fe80::60d2:cff:feb1:8775', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fede:7f47', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:feb6:73a3', 'fe80::38a4:7cff:fefd:e5ef'] Jun 26 02:53:28.833009 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:53:28.833088 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:53:28.833347 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] <== get_connector_properties: return (47ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:53:29.337706 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:53:29.338131 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7730da01-0f5e-4293-9e1c-5590aad808b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:53:29.338298 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:53:29.338776 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:53:29.338981 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7730da01-0f5e-4293-9e1c-5590aad808b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:53:29.349082 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:53:29.349492 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:53:29.349685 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:53:29.359724 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:53:29.359724 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:53:29.370996 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1] added Jun 26 02:53:29.370996 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:53:29.370996 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:53:29.370996 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:53:29.370996 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:53:29.370996 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:53:29.370996 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:53:29.371365 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:53:29.371652 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0219(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:53:29.371827 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:53:30.373839 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:53:30.389965 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:53:30.403816 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:53:30.417385 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:53:30.417385 np0000003683 cinder-backup[101221]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:53:30.417385 np0000003683 cinder-backup[101221]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash) Jun 26 02:53:30.417385 np0000003683 cinder-backup[101221]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash) Jun 26 02:53:30.417385 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:53:30.417616 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:53:30.417616 np0000003683 cinder-backup[101221]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:53:30.417616 np0000003683 cinder-backup[101221]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash) Jun 26 02:53:30.417616 np0000003683 cinder-backup[101221]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash) Jun 26 02:53:30.417616 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:53:30.451418 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1, portal: 192.168.40.100,3260] Jun 26 02:53:30.451418 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1, portal: 192.168.40.100,3260] successful. Jun 26 02:53:30.451418 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:53:30.465556 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:53:30.482903 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:53:30.482903 np0000003683 cinder-backup[101221]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:53:30.482903 np0000003683 cinder-backup[101221]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash) Jun 26 02:53:30.482903 np0000003683 cinder-backup[101221]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash) Jun 26 02:53:30.482903 np0000003683 cinder-backup[101221]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash) Jun 26 02:53:30.482903 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:53:30.483157 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:53:30.483157 np0000003683 cinder-backup[101221]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:53:30.483157 np0000003683 cinder-backup[101221]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash) Jun 26 02:53:30.483157 np0000003683 cinder-backup[101221]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11f3e00b-ca4b-4143-be48-fdc64beac752 (non-flash) Jun 26 02:53:30.483157 np0000003683 cinder-backup[101221]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash) Jun 26 02:53:30.483157 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:53:30.483572 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:53:30.483781 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:53:30.484720 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] HCTL ('11', '-', '-', 0) found on session 154 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:53:30.484926 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Scanning host 11 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:53:30.500186 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Searching for a device in session 154 and hctl ['11', '*', '*', 0] yield: None {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:53:31.501180 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Searching for a device in session 154 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:53:31.501596 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7730da01-0f5e-4293-9e1c-5590aad808b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:53:31.502082 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.163s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:53:31.502323 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] <== connect_volume: return (2163ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799130', 'path': '/dev/sdf'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:53:31.502665 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:53:31.525823 np0000003683 sudo[147636]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf Jun 26 02:53:31.526633 np0000003683 sudo[147636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:53:31.871058 np0000003683 sudo[147636]: pam_unix(sudo:session): session closed for user root Jun 26 02:53:31.873249 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf" returned: 0 in 0.370s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:53:31.910862 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:53:31.916695 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] _create_container started, container: tempest-volumesbackupsadmintest-backup-container-1208463645,backup: 5fe20ba2-218d-490b-9118-b4aa6049677d. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:53:32.047777 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] generate_object_name_prefix: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:53:32.052640 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] starting backup of volume: 7730da01-0f5e-4293-9e1c-5590aad808b1, volume size: 1073741824, object names prefix volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:53:32.229466 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:32.472594 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:32.472810 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:32.579986 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:32.580396 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:32.758935 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:33.002722 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:33.002853 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:33.102562 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:33.102713 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:33.287071 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:33.532121 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:33.532306 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:33.632232 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:33.632691 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:33.819972 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:34.067728 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:34.067931 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:34.174072 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:34.174277 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:34.373593 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:34.614218 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:34.614374 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:34.717204 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:34.717204 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:34.912229 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:35.158627 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:35.158881 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:35.255827 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:35.255974 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:35.437085 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:35.687850 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:35.688054 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:35.791680 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:35.792084 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:35.972247 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:36.223300 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:36.223488 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:36.324095 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:36.324226 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:36.506130 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:36.751999 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:36.752141 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:36.855762 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:36.856183 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:37.051931 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:37.305575 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:37.305798 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:37.407819 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:37.407989 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:37.612589 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:37.856241 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:37.856789 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:37.957810 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:37.957945 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:38.143386 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:38.383177 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:38.383440 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:38.486108 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:38.486310 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:38.679964 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:38.921535 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:38.921535 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:39.017952 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:39.018093 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:39.230464 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:39.495019 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:39.495291 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:39.594769 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:39.594945 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:39.795027 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:40.037530 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:40.037875 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:40.136521 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:40.136707 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:40.343431 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:40.584812 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:40.584984 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:40.683856 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:40.684025 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:40.863163 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:41.110751 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:41.111886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:41.209104 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:41.209321 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:41.379574 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:41.624387 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:41.624538 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:41.732866 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:41.733100 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:41.917443 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:42.187498 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:42.187793 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:42.309310 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:42.309524 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:42.516781 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:42.768211 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:42.768343 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:42.867640 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:42.867794 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:42.955563 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:53:43.085007 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:53:43.085241 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:53:43.147875 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:53:43.148040 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:53:43.154646 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:53:43.161629 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:53:43.161789 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:53:43.165594 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:53:43.165716 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:53:43.168584 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:53:43.168791 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] _write_sha256file started, container name: tempest-volumesbackupsadmintest-backup-container-1208463645, sha256file filename: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:53:43.227000 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:53:43.227678 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] _write_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-1208463645, metadata filename: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:53:43.251750 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "5fe20ba2-218d-490b-9118-b4aa6049677d",\n "backup_name": "tempest-VolumesBackupsAdminTest-Backup-1075566652",\n "created_at": "2026-06-26 02:53:29+00:00",\n "objects": [\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "7730da01-0f5e-4293-9e1c-5590aad808b1",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"7730da01-0f5e-4293-9e1c-5590aad808b1\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"f0457c70da9b425dbc2ac13bb2100173\\", \\"project_id\\": \\"114c0bf7bbc44628b0d55341c3995675\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:53:28.000000\\", \\"launched_at\\": \\"2026-06-26T02:53:28.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsAdminTest-Volume-1196348810\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:53:28.000000\\", \\"updated_at\\": \\"2026-06-26T02:53:29.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:53:43.256790 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] backup 5fe20ba2-218d-490b-9118-b4aa6049677d finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:53:43.378938 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:53:43.399091 np0000003683 sudo[148231]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf Jun 26 02:53:43.399868 np0000003683 sudo[148231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:53:43.725682 np0000003683 sudo[148231]: pam_unix(sudo:session): session closed for user root Jun 26 02:53:43.728066 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf" returned: 0 in 0.349s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:53:43.729500 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7730da01-0f5e-4293-9e1c-5590aad808b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799130', 'path': '/dev/sdf'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:53:43.729500 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:53:44.092268 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.363s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:53:44.093136 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7730da01-0f5e-4293-9e1c-5590aad808b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:53:44.105225 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:53:44.106159 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:53:44.106159 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:53:44.106159 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:53:44.106159 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:53:44.134910 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash) Jun 26 02:53:44.134910 np0000003683 cinder-backup[101221]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash) Jun 26 02:53:44.134910 np0000003683 cinder-backup[101221]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash) Jun 26 02:53:44.134910 np0000003683 cinder-backup[101221]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:53:44.134910 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:53:44.134910 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:53:44.134910 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:53:44.134910 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:53:44.135162 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1 (non-flash) Jun 26 02:53:44.135162 np0000003683 cinder-backup[101221]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash) Jun 26 02:53:44.135162 np0000003683 cinder-backup[101221]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d (non-flash) Jun 26 02:53:44.135162 np0000003683 cinder-backup[101221]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:53:44.135162 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:53:44.135162 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:53:44.135162 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:53:44.135162 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:53:44.135301 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1', '154'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17ff810d-0fd4-4404-895f-f8e3d3cdca9d', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '160')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:53:44.135408 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1', '154')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:53:44.136485 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Resulting device map defaultdict(. at 0x79db5ac747c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1'): ({'sdf'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:53:44.136701 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Removing single pathed devices sdf {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:53:44.146795 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Flushing IO for device /dev/sdf {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:53:44.154403 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:53:44.205890 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Checking to see if SCSI volumes sdf have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:53:44.206058 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] SCSI volumes sdf have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:53:44.207041 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Checking to see if device paths {'sdf'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:53:44.216686 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Device paths {'sdf'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:53:44.216966 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:53:44.227301 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:53:44.270756 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 154, target: iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1, portal: 192.168.40.100,3260] Jun 26 02:53:44.270756 np0000003683 cinder-backup[101221]: Logout of [sid: 154, target: iqn.2023-03.storpool.com:os--volume-7730da01-0f5e-4293-9e1c-5590aad808b1, portal: 192.168.40.100,3260] successful. Jun 26 02:53:44.270756 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:53:44.284941 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:53:44.285308 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.193s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:53:44.285532 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] <== disconnect_volume: return (556ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:53:45.307370 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-24ca864f-c256-495a-88e8-50125f3197d9 tempest-VolumesBackupsAdminTest-1620442085 None] Create backup finished. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d. Jun 26 02:53:46.225539 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-fb690fae-2164-4353-9b6a-a2f6714efc68 tempest-VolumesBackupsAdminTest-1709869487 None] Export record started, backup: 5fe20ba2-218d-490b-9118-b4aa6049677d. Jun 26 02:53:46.230934 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-fb690fae-2164-4353-9b6a-a2f6714efc68 tempest-VolumesBackupsAdminTest-1709869487 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_b8c0d1f9cd18422d898a67f5daca1a4f {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:53:46.231080 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-fb690fae-2164-4353-9b6a-a2f6714efc68 tempest-VolumesBackupsAdminTest-1709869487 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:53:46.232310 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-fb690fae-2164-4353-9b6a-a2f6714efc68 tempest-VolumesBackupsAdminTest-1709869487 None] Export record finished, backup 5fe20ba2-218d-490b-9118-b4aa6049677d exported. Jun 26 02:53:46.794189 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-3453bd84-8406-4ca8-9ef8-d544b3373391 tempest-VolumesBackupsAdminTest-1709869487 None] Import record started, backup_url: eyJkcml2ZXJfaW5mbyI6IHt9LCAiaWQiOiAiOWVkMzdmZGMtYjVkMy00MzI4LWIzYjgtMTNlZWIyYzczMTlkIiwgInVzZXJfaWQiOiAiZjA0NTdjNzBkYTliNDI1ZGJjMmFjMTNiYjIxMDAxNzMiLCAicHJvamVjdF9pZCI6ICIxMTRjMGJmN2JiYzQ0NjI4YjBkNTUzNDFjMzk5NTY3NSIsICJ2b2x1bWVfaWQiOiAiNzczMGRhMDEtMGY1ZS00MjkzLTllMWMtNTU5MGFhZDgwOGIxIiwgImhvc3QiOiAibnAwMDAwMDAzNjgzIiwgImF2YWlsYWJpbGl0eV96b25lIjogIm5vdmEiLCAiY29udGFpbmVyIjogInRlbXBlc3Qtdm9sdW1lc2JhY2t1cHNhZG1pbnRlc3QtYmFja3VwLWNvbnRhaW5lci0xMjA4NDYzNjQ1IiwgInBhcmVudF9pZCI6IG51bGwsICJzdGF0dXMiOiAiYXZhaWxhYmxlIiwgImZhaWxfcmVhc29uIjogbnVsbCwgInNpemUiOiAxLCAiZGlzcGxheV9uYW1lIjogInRlbXBlc3QtVm9sdW1lc0JhY2t1cHNBZG1pblRlc3QtQmFja3VwLTEwNzU1NjY2NTIiLCAiZGlzcGxheV9kZXNjcmlwdGlvbiI6IG51bGwsICJzZXJ2aWNlX21ldGFkYXRhIjogInZvbHVtZV83NzMwZGEwMS0wZjVlLTQyOTMtOWUxYy01NTkwYWFkODA4YjEvMjAyNjA2MjYwMjUzMzIvYXpfbm92YV9iYWNrdXBfNWZlMjBiYTItMjE4ZC00OTBiLTkxMTgtYjRhYTYwNDk2NzdkIiwgInNlcnZpY2UiOiAiY2luZGVyLmJhY2t1cC5kcml2ZXJzLnN3aWZ0LlN3aWZ0QmFja3VwRHJpdmVyIiwgIm9iamVjdF9jb3VudCI6IDIxLCAidGVtcF92b2x1bWVfaWQiOiBudWxsLCAidGVtcF9zbmFwc2hvdF9pZCI6IG51bGwsICJudW1fZGVwZW5kZW50X2JhY2t1cHMiOiAwLCAic25hcHNob3RfaWQiOiBudWxsLCAiZGF0YV90aW1lc3RhbXAiOiAiMjAyNi0wNi0yNlQwMjo1MzoyOVoiLCAicmVzdG9yZV92b2x1bWVfaWQiOiBudWxsLCAibWV0YWRhdGEiOiB7fSwgImVuY3J5cHRpb25fa2V5X2lkIjogbnVsbCwgImNyZWF0ZWRfYXQiOiAiMjAyNi0wNi0yNlQwMjo1MzoyOVoiLCAidXBkYXRlZF9hdCI6ICIyMDI2LTA2LTI2VDAyOjUzOjQ1WiIsICJkZWxldGVkX2F0IjogbnVsbCwgImRlbGV0ZWQiOiBmYWxzZX0=. Jun 26 02:53:46.794837 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-3453bd84-8406-4ca8-9ef8-d544b3373391 tempest-VolumesBackupsAdminTest-1709869487 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_b8c0d1f9cd18422d898a67f5daca1a4f {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:53:46.794966 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-3453bd84-8406-4ca8-9ef8-d544b3373391 tempest-VolumesBackupsAdminTest-1709869487 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:53:46.827325 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-3453bd84-8406-4ca8-9ef8-d544b3373391 tempest-VolumesBackupsAdminTest-1709869487 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:53:46.848525 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-3453bd84-8406-4ca8-9ef8-d544b3373391 tempest-VolumesBackupsAdminTest-1709869487 None] Import record id 9ed37fdc-b5d3-4328-b3b8-13eeb2c7319d metadata from driver finished. Jun 26 02:53:48.324709 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Create backup started, backup: aefe7a33-300f-4877-9367-e4ca536a037d volume: 9d49b35d-ed83-4b48-8eaa-e04ae16c4aae. Jun 26 02:53:48.331236 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-2102453304',created_at=2026-06-26T02:53:48Z,data_timestamp=2026-06-26T02:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-245394373',encryption_key_id=None,fail_reason=None,host='np0000003683',id=aefe7a33-300f-4877-9367-e4ca536a037d,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c05f689c58a04254b3930f0cc279148c',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3f08f0507eec40189b858129b4cc7fd1',volume_id=9d49b35d-ed83-4b48-8eaa-e04ae16c4aae) Jun 26 02:53:48.391747 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_c05f689c58a04254b3930f0cc279148c {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:53:48.391914 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:53:48.392181 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:53:48.402736 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:53:48.420716 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:53:48.433684 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:53:48.434030 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:53:48.441668 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:53:48.442695 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1b:478e', 'fe80::60d2:cff:feb1:8775', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fede:7f47', 'fe80::20a8:2eff:fe3d:d21b'] Jun 26 02:53:48.442816 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:53:48.442933 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:53:48.443210 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] <== get_connector_properties: return (50ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:53:48.946805 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:53:48.947231 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad80e257-ae89-4396-9ce5-f8a065890727', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:53:48.947422 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:53:49.046154 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Restore backup started, backup: 5fe20ba2-218d-490b-9118-b4aa6049677d volume: 13d678b8-f2c2-48ae-b417-891e7427930d. Jun 26 02:53:49.089721 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:53:49.098601 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_114c0bf7bbc44628b0d55341c3995675 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:53:49.098862 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:53:49.099207 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:53:49.108206 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:53:49.127365 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:53:49.142828 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:53:49.143170 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:53:49.152794 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:53:49.154327 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1b:478e', 'fe80::60d2:cff:feb1:8775', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fede:7f47', 'fe80::20a8:2eff:fe3d:d21b'] Jun 26 02:53:49.154601 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:53:49.154778 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:53:49.155457 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] <== get_connector_properties: return (55ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:53:50.165224 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:53:50.165689 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13d678b8-f2c2-48ae-b417-891e7427930d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:53:50.165841 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:53:50.719626 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-a333b490-193d-427d-9c3a-368f0d8effb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:53:57.974651 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 9.027s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:53:57.975058 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad80e257-ae89-4396-9ce5-f8a065890727', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:53:57.985207 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:53:57.985765 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:53:57.986027 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:53:57.996561 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:53:57.996561 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:53:58.008525 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727] added Jun 26 02:53:58.008525 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:53:58.008525 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:53:58.008525 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:53:58.008525 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:53:58.008525 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:53:58.008525 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:53:58.008712 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:53:58.009067 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.023(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:53:58.009308 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:53:59.011314 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:53:59.021696 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:53:59.033603 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:53:59.050878 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:53:59.050878 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:53:59.050878 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:53:59.050878 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:53:59.050878 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:53:59.050878 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:53:59.050878 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:53:59.050878 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:53:59.050878 np0000003683 cinder-backup[101221]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:53:59.050878 np0000003683 cinder-backup[101221]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:53:59.050878 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:53:59.051235 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:53:59.051235 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:53:59.051235 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:53:59.051235 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:53:59.051235 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:53:59.051235 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:53:59.051235 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:53:59.051235 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:53:59.051235 np0000003683 cinder-backup[101221]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:53:59.051235 np0000003683 cinder-backup[101221]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:53:59.051235 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:53:59.104366 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727, portal: 192.168.40.100,3260] Jun 26 02:53:59.104366 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727, portal: 192.168.40.100,3260] successful. Jun 26 02:53:59.104366 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:53:59.120132 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:53:59.142658 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:53:59.142658 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:53:59.142658 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:53:59.142658 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:53:59.142658 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:53:59.142658 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:53:59.142658 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:53:59.142658 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:53:59.142658 np0000003683 cinder-backup[101221]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:53:59.142658 np0000003683 cinder-backup[101221]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:53:59.142658 np0000003683 cinder-backup[101221]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash) Jun 26 02:53:59.142658 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:53:59.143046 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:53:59.143046 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:53:59.143046 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:53:59.143046 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:53:59.143046 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:53:59.143046 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:53:59.143046 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:53:59.143046 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:53:59.143046 np0000003683 cinder-backup[101221]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:53:59.143046 np0000003683 cinder-backup[101221]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:53:59.143046 np0000003683 cinder-backup[101221]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash) Jun 26 02:53:59.143046 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:53:59.143268 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:53:59.143441 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:53:59.144807 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] HCTL ('17', '-', '-', 0) found on session 167 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:53:59.144972 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Scanning host 17 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:53:59.157405 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Searching for a device in session 167 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:53:59.157405 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad80e257-ae89-4396-9ce5-f8a065890727', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:54:00.160003 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.185s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:54:00.160568 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] <== connect_volume: return (11212ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799138', 'path': '/dev/sdl'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:54:00.160568 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdl {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:54:00.167392 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 10.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:54:00.167792 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13d678b8-f2c2-48ae-b417-891e7427930d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:54:00.181436 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:54:00.181436 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:54:00.181436 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:54:00.180739 np0000003683 sudo[149340]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdl Jun 26 02:54:00.181330 np0000003683 sudo[149340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:54:00.194237 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:54:00.194237 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:00.205666 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d] added Jun 26 02:54:00.205666 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:54:00.205666 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:54:00.205666 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:54:00.205666 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:54:00.205666 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:54:00.205666 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:00.205666 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:54:00.206025 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:54:00.206345 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:54:00.496280 np0000003683 sudo[149340]: pam_unix(sudo:session): session closed for user root Jun 26 02:54:00.498082 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdl" returned: 0 in 0.337s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:54:00.507487 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] _create_container started, container: tempest-volumesbackupstest-backup-container-2102453304,backup: aefe7a33-300f-4877-9367-e4ca536a037d. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:54:00.572795 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] generate_object_name_prefix: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:54:00.583139 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] starting backup of volume: 9d49b35d-ed83-4b48-8eaa-e04ae16c4aae, volume size: 1073741824, object names prefix volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:54:00.802756 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:01.078071 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:01.078516 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:01.207869 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:54:01.216616 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:01.216844 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:54:01.223250 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:01.237276 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:01.259756 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:01.259756 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:01.259756 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:01.259756 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:01.259756 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:01.259756 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:01.259756 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:01.259756 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:01.259756 np0000003683 cinder-backup[101221]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:54:01.259756 np0000003683 cinder-backup[101221]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:54:01.259756 np0000003683 cinder-backup[101221]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash) Jun 26 02:54:01.259756 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:01.260377 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:01.260377 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:01.260377 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:01.260377 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:01.260377 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:01.260377 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:01.260377 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:01.260377 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:01.260377 np0000003683 cinder-backup[101221]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:54:01.260377 np0000003683 cinder-backup[101221]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:54:01.260377 np0000003683 cinder-backup[101221]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash) Jun 26 02:54:01.260377 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:54:01.324082 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d, portal: 192.168.40.100,3260] Jun 26 02:54:01.324082 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d, portal: 192.168.40.100,3260] successful. Jun 26 02:54:01.324082 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:01.345793 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:01.384211 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:01.384211 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:01.384211 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:01.384211 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:01.384211 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:01.384211 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:01.384211 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:01.384211 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:01.384211 np0000003683 cinder-backup[101221]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:54:01.384211 np0000003683 cinder-backup[101221]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:54:01.384211 np0000003683 cinder-backup[101221]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash) Jun 26 02:54:01.384211 np0000003683 cinder-backup[101221]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d (non-flash) Jun 26 02:54:01.384211 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:01.384679 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:01.384679 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:01.384679 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:01.384679 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:01.384679 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:01.384679 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:01.384679 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:01.384679 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:01.384679 np0000003683 cinder-backup[101221]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:54:01.384679 np0000003683 cinder-backup[101221]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:54:01.384679 np0000003683 cinder-backup[101221]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash) Jun 26 02:54:01.384679 np0000003683 cinder-backup[101221]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d (non-flash) Jun 26 02:54:01.384679 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:54:01.384679 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.204s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:54:01.385047 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:54:01.385928 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] HCTL ('18', '-', '-', 0) found on session 168 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:54:01.386285 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Scanning host 18 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:54:01.410702 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Searching for a device in session 168 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:54:01.410702 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13d678b8-f2c2-48ae-b417-891e7427930d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:54:01.500180 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:01.751714 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:01.751944 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:01.891455 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:01.891653 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:02.149216 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:02.415506 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.249s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:54:02.415956 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] <== connect_volume: return (12249ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799136', 'path': '/dev/sdm'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:54:02.416141 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdm {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:54:02.445024 np0000003683 sudo[149719]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdm Jun 26 02:54:02.445822 np0000003683 sudo[149719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:54:02.466040 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:02.466343 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:02.597976 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:02.598266 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:02.783404 np0000003683 sudo[149719]: pam_unix(sudo:session): session closed for user root Jun 26 02:54:02.785469 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdm" returned: 0 in 0.369s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:54:02.785935 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] starting restore of backup volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d container: tempest-volumesbackupsadmintest-backup-container-1208463645, to new volume 13d678b8-f2c2-48ae-b417-891e7427930d, backup: 5fe20ba2-218d-490b-9118-b4aa6049677d. {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jun 26 02:54:02.786170 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] _read_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-1208463645, metadata filename: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d_metadata. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jun 26 02:54:02.831202 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] _read_metadata finished. Metadata: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "backup_description": null, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "backup_id": "5fe20ba2-218d-490b-9118-b4aa6049677d", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "backup_name": "tempest-VolumesBackupsAdminTest-Backup-1075566652", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "created_at": "2026-06-26 02:53:29+00:00", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "objects": [ Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00001": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 0 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00002": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 52428800 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00003": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 104857600 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00004": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 157286400 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00005": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 209715200 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00006": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 262144000 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00007": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 314572800 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00008": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 367001600 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00009": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 419430400 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00010": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 471859200 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00011": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 524288000 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00012": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 576716800 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00013": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 629145600 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00014": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 681574400 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00015": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 734003200 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00016": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 786432000 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00017": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 838860800 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00018": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 891289600 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00019": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 943718400 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00020": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 996147200 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00021": { Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "length": 25165824, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "offset": 1048576000 Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: ], Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "parent_id": null, Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "version": "1.0.0", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_id": "7730da01-0f5e-4293-9e1c-5590aad808b1", Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"7730da01-0f5e-4293-9e1c-5590aad808b1\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"f0457c70da9b425dbc2ac13bb2100173\", \"project_id\": \"114c0bf7bbc44628b0d55341c3995675\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000003683@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-06-26T02:53:28.000000\", \"launched_at\": \"2026-06-26T02:53:28.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsAdminTest-Volume-1196348810\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"268cd356-e153-49dd-857f-2ea5794ac5be\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"26cf225a-ef51-42c6-990c-f9523cca3d45\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-06-26T02:53:28.000000\", \"updated_at\": \"2026-06-26T02:53:29.000000\"}}" Jun 26 02:54:02.849207 np0000003683 cinder-backup[101221]: }. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jun 26 02:54:02.852722 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Restoring backup version 1.0.0 {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jun 26 02:54:02.852722 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] _read_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-1208463645, metadata filename: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d_metadata. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] _read_metadata finished. Metadata: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "backup_description": null, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "backup_id": "5fe20ba2-218d-490b-9118-b4aa6049677d", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "backup_name": "tempest-VolumesBackupsAdminTest-Backup-1075566652", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "created_at": "2026-06-26 02:53:29+00:00", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "objects": [ Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00001": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 0 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00002": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 52428800 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00003": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 104857600 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00004": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 157286400 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00005": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 209715200 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00006": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 262144000 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00007": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 314572800 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00008": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 367001600 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00009": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 419430400 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00010": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 471859200 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00011": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 524288000 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00012": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 576716800 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00013": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 629145600 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00014": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 681574400 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00015": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 734003200 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00016": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 786432000 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00017": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 838860800 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00018": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 891289600 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00019": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 943718400 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00020": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 996147200 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00021": { Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "length": 25165824, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "offset": 1048576000 Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: } Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: ], Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "parent_id": null, Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "version": "1.0.0", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_id": "7730da01-0f5e-4293-9e1c-5590aad808b1", Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"7730da01-0f5e-4293-9e1c-5590aad808b1\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"f0457c70da9b425dbc2ac13bb2100173\", \"project_id\": \"114c0bf7bbc44628b0d55341c3995675\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000003683@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-06-26T02:53:28.000000\", \"launched_at\": \"2026-06-26T02:53:28.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsAdminTest-Volume-1196348810\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"268cd356-e153-49dd-857f-2ea5794ac5be\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"26cf225a-ef51-42c6-990c-f9523cca3d45\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-06-26T02:53:28.000000\", \"updated_at\": \"2026-06-26T02:53:29.000000\"}}" Jun 26 02:54:02.872193 np0000003683 cinder-backup[101221]: }. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jun 26 02:54:02.875997 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] v1 volume backup restore of 5fe20ba2-218d-490b-9118-b4aa6049677d started. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jun 26 02:54:02.875997 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] metadata_object_names = ['volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00001', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00002', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00003', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00004', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00005', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00006', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00007', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00008', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00009', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00010', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00011', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00012', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00013', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00014', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00015', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00016', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00017', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00018', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00019', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00020', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00021']. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jun 26 02:54:02.923967 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] generated object list: ['volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00001', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00002', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00003', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00004', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00005', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00006', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00007', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00008', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00009', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00010', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00011', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00012', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00013', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00014', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00015', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00016', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00017', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00018', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00019', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00020', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00021', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d_metadata', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:54:02.927770 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00001, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:02.942412 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:03.085296 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:03.085296 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:03.326795 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00002, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:03.346738 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:03.398662 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:03.398941 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:03.718272 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00003, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:03.740216 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:03.751296 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:04.068961 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:04.069252 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:04.077377 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00004, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:04.104192 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:04.202663 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:04.202956 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:04.484504 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00005, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:04.509163 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:04.524500 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:04.846852 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:04.847363 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:04.854003 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00006, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:04.873152 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:04.964486 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:04.964486 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:05.348411 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00007, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:05.369098 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:05.373695 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:05.714445 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:05.714733 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:05.721646 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00008, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:05.749307 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:05.845226 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:05.845226 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:06.182632 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00009, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:06.205005 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:06.223929 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:06.556145 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:06.556370 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:06.564192 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00010, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:06.577289 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:06.659943 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:06.660199 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:06.929974 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00011, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:06.945030 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:06.968731 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:07.284777 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:07.285295 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:07.291707 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00012, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:07.309561 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:07.394446 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:07.395666 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:07.660569 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00013, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:07.674565 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:07.698558 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:08.021686 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:08.021810 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:08.027556 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00014, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:08.042512 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:08.128791 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:08.128960 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:08.392071 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00015, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:08.409866 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:08.429891 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:08.738559 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:08.738747 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:08.743927 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00016, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:08.764456 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:08.853289 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:08.854520 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:09.120007 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00017, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:09.136813 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:09.163961 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:09.465357 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:09.465722 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:09.473515 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00018, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:09.494563 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:09.588240 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:09.588488 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:09.846616 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00019, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:09.866672 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:09.892900 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:10.236629 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:10.236919 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:10.244396 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00020, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:10.265553 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:10.353656 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:10.353858 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:10.617536 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restoring object. backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, object name: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00021, volume: 13d678b8-f2c2-48ae-b417-891e7427930d. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:54:10.656511 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:54:10.667440 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:10.843958 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] v1 volume backup restore of 5fe20ba2-218d-490b-9118-b4aa6049677d finished. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jun 26 02:54:10.844327 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Restoring volume base metadata {{(pid=101221) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jun 26 02:54:10.864131 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] No metadata of type 'volume-metadata' to restore {{(pid=101221) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jun 26 02:54:10.864365 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101221) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jun 26 02:54:10.864603 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] restore 5fe20ba2-218d-490b-9118-b4aa6049677d to 13d678b8-f2c2-48ae-b417-891e7427930d finished. {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jun 26 02:54:10.865132 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdm {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:54:10.893647 np0000003683 sudo[150335]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdm Jun 26 02:54:10.894602 np0000003683 sudo[150335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:54:10.958520 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:10.958874 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:11.084113 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:11.084337 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:11.277270 np0000003683 sudo[150335]: pam_unix(sudo:session): session closed for user root Jun 26 02:54:11.279674 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdm" returned: 0 in 0.415s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:54:11.280158 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13d678b8-f2c2-48ae-b417-891e7427930d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799136', 'path': '/dev/sdm'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:54:11.280338 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:54:11.283285 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:54:11.283652 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13d678b8-f2c2-48ae-b417-891e7427930d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:54:11.297024 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:11.297910 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:54:11.297910 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:54:11.297910 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:54:11.297910 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:54:11.305500 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:11.326606 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:11.326606 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:11.326606 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:11.326606 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:11.326606 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:11.326606 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:11.326606 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:11.326606 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:11.326606 np0000003683 cinder-backup[101221]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:54:11.326606 np0000003683 cinder-backup[101221]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:54:11.326606 np0000003683 cinder-backup[101221]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash) Jun 26 02:54:11.326606 np0000003683 cinder-backup[101221]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d (non-flash) Jun 26 02:54:11.326606 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:11.326606 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:11.326606 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:11.326973 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:11.326973 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:11.326973 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:11.326973 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:11.326973 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:11.326973 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:11.326973 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:11.326973 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:11.326973 np0000003683 cinder-backup[101221]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:54:11.326973 np0000003683 cinder-backup[101221]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:54:11.326973 np0000003683 cinder-backup[101221]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash) Jun 26 02:54:11.326973 np0000003683 cinder-backup[101221]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d (non-flash) Jun 26 02:54:11.326973 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:11.326973 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:11.326973 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:54:11.326973 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '164'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '170')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:54:11.327297 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d', '168')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:54:11.328720 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Resulting device map defaultdict(. at 0x79db5a3f5580>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d'): ({'sdm'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:54:11.329027 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Removing single pathed devices sdm {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:54:11.343347 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Flushing IO for device /dev/sdm {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:54:11.350371 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:54:11.392866 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Checking to see if SCSI volumes sdm have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:54:11.393033 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] SCSI volumes sdm have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:54:11.394458 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Checking to see if device paths {'sdm'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:54:11.404282 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Device paths {'sdm'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:54:11.404536 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:54:11.415060 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:11.451768 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 168, target: iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d, portal: 192.168.40.100,3260] Jun 26 02:54:11.451768 np0000003683 cinder-backup[101221]: Logout of [sid: 168, target: iqn.2023-03.storpool.com:os--volume-13d678b8-f2c2-48ae-b417-891e7427930d, portal: 192.168.40.100,3260] successful. Jun 26 02:54:11.451768 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:11.475712 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:11.476021 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.193s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:54:11.476209 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] <== disconnect_volume: return (195ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:54:11.565715 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:11.566000 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:11.675167 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:11.675577 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:11.870123 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:12.122014 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:12.122217 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:12.235902 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:12.236159 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:12.442506 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:12.490094 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.manager [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Encryption key ID for volume 13d678b8-f2c2-48ae-b417-891e7427930d already matches encryption key ID in backup 5fe20ba2-218d-490b-9118-b4aa6049677d. {{(pid=101221) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jun 26 02:54:12.510128 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-6d85b4d5-dd10-4ffa-8734-36d6fcf28140 tempest-VolumesBackupsAdminTest-1620442085 None] Finished restoring backup 5fe20ba2-218d-490b-9118-b4aa6049677d to volume 13d678b8-f2c2-48ae-b417-891e7427930d. Jun 26 02:54:12.695495 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:12.695858 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:12.700502 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:54:12.700502 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:54:12.716572 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-4416ba7e-9638-4eb1-bbf5-2b3d2594c22f tempest-VolumesBackupsAdminTest-1709869487 None] Delete backup started, backup: 9ed37fdc-b5d3-4328-b3b8-13eeb2c7319d. Jun 26 02:54:12.726979 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-4416ba7e-9638-4eb1-bbf5-2b3d2594c22f tempest-VolumesBackupsAdminTest-1709869487 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_b8c0d1f9cd18422d898a67f5daca1a4f {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:54:12.727649 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-4416ba7e-9638-4eb1-bbf5-2b3d2594c22f tempest-VolumesBackupsAdminTest-1709869487 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:54:12.727906 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4416ba7e-9638-4eb1-bbf5-2b3d2594c22f tempest-VolumesBackupsAdminTest-1709869487 None] delete started, backup: 9ed37fdc-b5d3-4328-b3b8-13eeb2c7319d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, prefix: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:54:12.771677 np0000003683 cinder-backup[101221]: WARNING cinder.backup.chunkeddriver [None req-4416ba7e-9638-4eb1-bbf5-2b3d2594c22f tempest-VolumesBackupsAdminTest-1709869487 None] Error while listing objects, continuing with delete.: swiftclient.exceptions.ClientException: Container GET failed: https://10.4.3.9:8080/v1/AUTH_b8c0d1f9cd18422d898a67f5daca1a4f/tempest-volumesbackupsadmintest-backup-container-1208463645?format=json&prefix=volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' (txn: tx0f02b350a7ee4857ac092-006a3de9d4) Jun 26 02:54:12.771968 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4416ba7e-9638-4eb1-bbf5-2b3d2594c22f tempest-VolumesBackupsAdminTest-1709869487 None] delete 9ed37fdc-b5d3-4328-b3b8-13eeb2c7319d finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:54:12.809916 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:12.810039 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:12.837925 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-4416ba7e-9638-4eb1-bbf5-2b3d2594c22f tempest-VolumesBackupsAdminTest-1709869487 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:54:12.858126 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-4416ba7e-9638-4eb1-bbf5-2b3d2594c22f tempest-VolumesBackupsAdminTest-1709869487 None] Created reservations ['0b728be6-f4e8-4e8c-98d2-5c8ba108ccf6', 'eea2e6f5-b64a-40bf-ba0a-c3ac2e5e9c7e'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:54:12.887770 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-4416ba7e-9638-4eb1-bbf5-2b3d2594c22f tempest-VolumesBackupsAdminTest-1709869487 None] Delete backup finished, backup 9ed37fdc-b5d3-4328-b3b8-13eeb2c7319d deleted. Jun 26 02:54:13.061301 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:13.321587 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:13.321759 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:13.449608 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:13.449761 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:13.792016 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:13.799960 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] Delete backup started, backup: 5fe20ba2-218d-490b-9118-b4aa6049677d. Jun 26 02:54:13.804625 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_114c0bf7bbc44628b0d55341c3995675 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:54:13.804803 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:54:13.805020 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] delete started, backup: 5fe20ba2-218d-490b-9118-b4aa6049677d, container: tempest-volumesbackupsadmintest-backup-container-1208463645, prefix: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:54:13.840778 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] generated object list: ['volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00001', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00002', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00003', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00004', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00005', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00006', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00007', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00008', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00009', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00010', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00011', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00012', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00013', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00014', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00015', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00016', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00017', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00018', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00019', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00020', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00021', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d_metadata', 'volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:54:13.865499 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00001 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:13.892395 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00002 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:13.913664 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00003 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:13.933358 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00004 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:13.953321 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00005 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:13.973568 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00006 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:13.993103 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00007 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:14.014043 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00008 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:14.030360 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00009 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:14.050757 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00010 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:14.068313 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00011 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:14.075499 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:14.075699 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:14.084952 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00012 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:14.114745 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00013 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:14.144695 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00014 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:14.171754 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00015 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:14.193034 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00016 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:14.197171 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:14.197397 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:14.238970 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:54:14.255162 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00017 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:14.282917 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00018 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:14.305006 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00019 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:14.329711 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00020 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:14.351987 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d-00021 in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:14.375263 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d_metadata in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:14.395683 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_7730da01-0f5e-4293-9e1c-5590aad808b1/20260626025332/az_nova_backup_5fe20ba2-218d-490b-9118-b4aa6049677d_sha256file in container: tempest-volumesbackupsadmintest-backup-container-1208463645. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:14.396041 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] delete 5fe20ba2-218d-490b-9118-b4aa6049677d finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:54:14.411873 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] Created reservations ['0bcd645b-4234-4ef1-9b75-c3d5d9c7a873', '38a8cb64-7cda-4e04-a624-527114e5df61'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:54:14.430771 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-08280018-88e9-4123-8775-c63947f663df tempest-VolumesBackupsAdminTest-1620442085 None] Delete backup finished, backup 5fe20ba2-218d-490b-9118-b4aa6049677d deleted. Jun 26 02:54:14.448225 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:14.707925 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:14.708108 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:14.809584 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:14.810126 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:14.906186 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:15.032836 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:15.033060 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:15.097409 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup MD5 for volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:15.097605 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:15.105172 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:54:15.110307 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:54:15.110456 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:54:15.114151 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:54:15.114310 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:54:15.117164 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:54:15.117390 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-2102453304, sha256file filename: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:54:15.196217 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:54:15.197013 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-2102453304, metadata filename: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:54:15.229015 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "aefe7a33-300f-4877-9367-e4ca536a037d",\n "backup_name": "tempest-VolumesBackupsTest-Backup-245394373",\n "created_at": "2026-06-26 02:53:48+00:00",\n "objects": [\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "9d49b35d-ed83-4b48-8eaa-e04ae16c4aae",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"9d49b35d-ed83-4b48-8eaa-e04ae16c4aae\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"3f08f0507eec40189b858129b4cc7fd1\\", \\"project_id\\": \\"c05f689c58a04254b3930f0cc279148c\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:52:40.000000\\", \\"launched_at\\": \\"2026-06-26T02:52:40.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-2010384547\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:52:40.000000\\", \\"updated_at\\": \\"2026-06-26T02:53:48.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:54:15.236343 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] backup aefe7a33-300f-4877-9367-e4ca536a037d finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:54:15.375157 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdl {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:54:15.397382 np0000003683 sudo[150426]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdl Jun 26 02:54:15.398399 np0000003683 sudo[150426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:54:15.749593 np0000003683 sudo[150426]: pam_unix(sudo:session): session closed for user root Jun 26 02:54:15.751618 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdl" returned: 0 in 0.376s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:54:15.752314 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad80e257-ae89-4396-9ce5-f8a065890727', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799138', 'path': '/dev/sdl'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:54:15.752581 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:54:15.753136 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:54:15.753629 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad80e257-ae89-4396-9ce5-f8a065890727', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:54:15.766231 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:15.767018 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:54:15.767018 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:54:15.767018 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:54:15.767018 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:54:15.794994 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:15.794994 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:15.794994 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:15.794994 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:15.794994 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:15.794994 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:15.794994 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:15.794994 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:15.794994 np0000003683 cinder-backup[101221]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:54:15.794994 np0000003683 cinder-backup[101221]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:54:15.794994 np0000003683 cinder-backup[101221]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash) Jun 26 02:54:15.794994 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:15.794994 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:15.794994 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:15.795910 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:15.795910 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:15.795910 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:15.795910 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:15.795910 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:15.795910 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:15.795910 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:15.795910 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:15.795910 np0000003683 cinder-backup[101221]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:54:15.795910 np0000003683 cinder-backup[101221]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d (non-flash) Jun 26 02:54:15.795910 np0000003683 cinder-backup[101221]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727 (non-flash) Jun 26 02:54:15.795910 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:15.795910 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:15.795910 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:54:15.795910 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '164'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0b9cf06-70bc-407d-a438-a14a397c553d', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727', '167'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '170')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:54:15.795910 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727', '167')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:54:15.797097 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Resulting device map defaultdict(. at 0x79db5a079bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727'): ({'sdl'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:54:15.797349 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Removing single pathed devices sdl {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:54:15.808505 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Flushing IO for device /dev/sdl {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:54:15.817648 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:54:15.865965 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Checking to see if SCSI volumes sdl have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:54:15.866185 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] SCSI volumes sdl have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:54:15.868291 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Checking to see if device paths {'sdl'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:54:15.879660 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Device paths {'sdl'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:54:15.880011 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:54:15.890886 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:15.930469 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 167, target: iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727, portal: 192.168.40.100,3260] Jun 26 02:54:15.930469 np0000003683 cinder-backup[101221]: Logout of [sid: 167, target: iqn.2023-03.storpool.com:os--volume-ad80e257-ae89-4396-9ce5-f8a065890727, portal: 192.168.40.100,3260] successful. Jun 26 02:54:15.930469 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:15.956041 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:15.956398 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.203s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:54:15.956600 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] <== disconnect_volume: return (203ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:54:17.010221 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-7d5b0775-052b-4285-9314-9d64a23d65e0 tempest-VolumesBackupsTest-1738581805 None] Create backup finished. backup: aefe7a33-300f-4877-9367-e4ca536a037d. Jun 26 02:54:17.378993 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Create backup started, backup: 6ad41494-3c08-40d2-9ad5-b2c12faf433a volume: 8bfc7aa6-1746-4bb3-80ed-6c073d3c1129. Jun 26 02:54:17.383347 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupsadmintest-backup-container-482573766',created_at=2026-06-26T02:54:17Z,data_timestamp=2026-06-26T02:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1626414748',encryption_key_id=None,fail_reason=None,host='np0000003683',id=6ad41494-3c08-40d2-9ad5-b2c12faf433a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='114c0bf7bbc44628b0d55341c3995675',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f0457c70da9b425dbc2ac13bb2100173',volume_id=8bfc7aa6-1746-4bb3-80ed-6c073d3c1129) Jun 26 02:54:17.408652 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_114c0bf7bbc44628b0d55341c3995675 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:54:17.408841 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:54:17.409232 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:54:17.421501 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:54:17.442828 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:54:17.458986 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:54:17.459360 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:54:17.468337 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:54:17.470004 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1b:478e', 'fe80::60d2:cff:feb1:8775', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fede:7f47', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:feb6:73a3', 'fe80::38a4:7cff:fefd:e5ef', 'fe80::fc16:3eff:fe77:fb01'] Jun 26 02:54:17.470193 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:54:17.470355 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:54:17.470688 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] <== get_connector_properties: return (60ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:54:17.975299 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:54:17.975972 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8bfc7aa6-1746-4bb3-80ed-6c073d3c1129', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:54:17.976175 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:54:17.976719 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:54:17.976979 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8bfc7aa6-1746-4bb3-80ed-6c073d3c1129', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:54:17.987966 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:54:17.988358 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:54:17.988614 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:54:17.999585 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:54:17.999585 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:18.010258 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129] added Jun 26 02:54:18.010258 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:54:18.010258 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:54:18.010258 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:54:18.010258 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:54:18.010258 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:54:18.010258 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:18.010859 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:54:18.010859 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0221(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:54:18.010958 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:54:18.158654 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:54:18.166457 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Create backup started, backup: aa091326-bf1f-4c49-9fdd-954165520367 volume: 9d49b35d-ed83-4b48-8eaa-e04ae16c4aae. Jun 26 02:54:18.171265 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-06-26T02:54:18Z,data_timestamp=2026-06-26T02:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='np0000003683',id=aa091326-bf1f-4c49-9fdd-954165520367,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(aefe7a33-300f-4877-9367-e4ca536a037d),parent_id='aefe7a33-300f-4877-9367-e4ca536a037d',project_id='c05f689c58a04254b3930f0cc279148c',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3f08f0507eec40189b858129b4cc7fd1',volume_id=9d49b35d-ed83-4b48-8eaa-e04ae16c4aae) Jun 26 02:54:18.245299 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_c05f689c58a04254b3930f0cc279148c {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:54:18.245558 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:54:18.245859 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:54:18.258398 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:54:18.281532 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:54:18.298501 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:54:18.298501 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:54:18.304909 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:54:18.306095 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1b:478e', 'fe80::60d2:cff:feb1:8775', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fede:7f47', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:feb6:73a3', 'fe80::38a4:7cff:fefd:e5ef', 'fe80::fc16:3eff:fe77:fb01'] Jun 26 02:54:18.306338 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:54:18.306469 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:54:18.306719 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] <== get_connector_properties: return (60ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:54:18.810311 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:54:18.810832 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:54:18.811282 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:54:19.011766 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:54:19.023236 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:19.035575 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:19.051465 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:19.051465 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:19.051465 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:19.051465 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:19.051465 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:19.051465 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:19.051465 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:19.051465 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:19.051465 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:19.051465 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:19.051465 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:19.051958 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:19.051958 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:19.051958 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:19.051958 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:19.051958 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:19.051958 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:19.051958 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:19.051958 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:19.051958 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:19.051958 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:19.051958 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:54:19.098818 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129, portal: 192.168.40.100,3260] Jun 26 02:54:19.098818 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129, portal: 192.168.40.100,3260] successful. Jun 26 02:54:19.098818 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:19.109058 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:19.125675 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:19.125675 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:19.125675 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:19.125675 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:19.125675 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:19.125675 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:19.125675 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:19.125675 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:19.125675 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:19.125675 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:19.125675 np0000003683 cinder-backup[101221]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129 (non-flash) Jun 26 02:54:19.125675 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:19.125967 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:19.125967 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:19.125967 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:19.125967 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:19.125967 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:19.125967 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:19.125967 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:19.125967 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:19.125967 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:19.125967 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:19.125967 np0000003683 cinder-backup[101221]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129 (non-flash) Jun 26 02:54:19.125967 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:54:19.126415 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:54:19.126614 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:54:19.127837 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] HCTL ('15', '-', '-', 0) found on session 171 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:54:19.127984 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Scanning host 15 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:54:19.140814 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Searching for a device in session 171 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:54:19.140905 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8bfc7aa6-1746-4bb3-80ed-6c073d3c1129', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:54:20.144632 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.168s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:54:20.145066 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] <== connect_volume: return (2169ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799140', 'path': '/dev/sdj'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:54:20.145192 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:54:20.151995 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.340s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:54:20.152401 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:54:20.166321 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:54:20.166297 np0000003683 sudo[150649]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj Jun 26 02:54:20.166934 np0000003683 sudo[150649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:54:20.167567 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:54:20.167567 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:54:20.177674 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:54:20.177674 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:20.188012 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6] added Jun 26 02:54:20.188012 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:54:20.188012 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:54:20.188012 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:54:20.188012 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:54:20.188012 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:54:20.188012 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:20.188344 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:54:20.188895 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0216(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:54:20.189106 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:54:20.470648 np0000003683 sudo[150649]: pam_unix(sudo:session): session closed for user root Jun 26 02:54:20.472710 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj" returned: 0 in 0.327s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:54:20.525699 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:54:20.532352 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] _create_container started, container: tempest-volumesbackupsadmintest-backup-container-482573766,backup: 6ad41494-3c08-40d2-9ad5-b2c12faf433a. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:54:20.590406 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] generate_object_name_prefix: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:54:20.599015 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] starting backup of volume: 8bfc7aa6-1746-4bb3-80ed-6c073d3c1129, volume size: 1073741824, object names prefix volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:54:20.814172 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:21.056614 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:21.056802 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:21.162674 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:21.163124 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:21.190440 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:54:21.201462 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:21.214943 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:21.233327 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:21.233327 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:21.233327 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:21.233327 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:21.233327 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:21.233327 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:21.233327 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:21.233327 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:21.233327 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:21.233327 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:21.233327 np0000003683 cinder-backup[101221]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129 (non-flash) Jun 26 02:54:21.233327 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:21.233844 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:21.233844 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:21.233844 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:21.233844 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:21.233844 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:21.233844 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:21.233844 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:21.233844 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:21.233844 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:21.233844 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:21.233844 np0000003683 cinder-backup[101221]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129 (non-flash) Jun 26 02:54:21.233844 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:54:21.278185 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6, portal: 192.168.40.100,3260] Jun 26 02:54:21.278185 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6, portal: 192.168.40.100,3260] successful. Jun 26 02:54:21.278185 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:21.292710 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:21.310943 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:21.310943 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:21.310943 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:21.310943 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:21.310943 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:21.310943 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:21.310943 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:21.310943 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:21.310943 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:21.310943 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:21.310943 np0000003683 cinder-backup[101221]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129 (non-flash) Jun 26 02:54:21.310943 np0000003683 cinder-backup[101221]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6 (non-flash) Jun 26 02:54:21.310943 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:21.311328 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:21.311328 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:21.311328 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:21.311328 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:21.311328 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:21.311328 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:21.311328 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:21.311328 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:21.311328 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:21.311328 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:21.311328 np0000003683 cinder-backup[101221]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129 (non-flash) Jun 26 02:54:21.311328 np0000003683 cinder-backup[101221]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6 (non-flash) Jun 26 02:54:21.311328 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:54:21.311606 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:54:21.311776 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:54:21.313282 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] HCTL ('16', '-', '-', 0) found on session 172 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:54:21.313443 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Scanning host 16 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:54:21.325769 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Searching for a device in session 172 and hctl ['16', '*', '*', 0] yield: None {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:54:21.393839 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:21.642988 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:21.643136 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:21.739771 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:21.739972 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:21.940405 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:22.179533 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:22.179998 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:22.285938 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:22.286126 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:22.327177 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Searching for a device in session 172 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:54:22.327462 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:54:22.328376 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.177s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:54:22.328662 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] <== connect_volume: return (3517ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799142', 'path': '/dev/sdk'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:54:22.329150 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:54:22.386099 np0000003683 sudo[150715]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk Jun 26 02:54:22.388127 np0000003683 sudo[150715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:54:22.508389 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:22.724493 np0000003683 sudo[150715]: pam_unix(sudo:session): session closed for user root Jun 26 02:54:22.726286 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk" returned: 0 in 0.397s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:54:22.733143 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] _read_sha256file started, container name: tempest-volumesbackupstest-backup-container-2102453304, sha256 filename: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d_sha256file. {{(pid=101221) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jun 26 02:54:22.757135 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:22.757274 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:22.764423 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] _read_sha256file finished. {{(pid=101221) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jun 26 02:54:22.773024 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] _create_container started, container: volumebackups,backup: aa091326-bf1f-4c49-9fdd-954165520367. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:54:22.824053 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] generate_object_name_prefix: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025422/az_nova_backup_aa091326-bf1f-4c49-9fdd-954165520367 {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:54:22.828632 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] starting backup of volume: 9d49b35d-ed83-4b48-8eaa-e04ae16c4aae, volume size: 1073741824, object names prefix volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025422/az_nova_backup_aa091326-bf1f-4c49-9fdd-954165520367, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:54:22.871759 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:22.871954 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:23.150906 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:23.421287 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:23.421812 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:23.531053 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:23.531344 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:23.841770 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:24.100464 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:24.100703 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:24.209272 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:24.209518 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:24.542562 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:25.107838 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:25.107838 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:25.238974 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:25.239181 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:25.573142 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:25.830889 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:25.830889 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:25.949451 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:25.949994 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:26.248755 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:26.523855 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:26.523855 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:26.653760 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:26.654767 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:26.949205 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:27.224967 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:27.224967 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:27.388253 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:27.388253 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:27.657242 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:27.745415 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:54:27.752047 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:54:27.752047 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:54:27.754912 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:54:27.755231 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:54:27.758428 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:54:27.761496 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025422/az_nova_backup_aa091326-bf1f-4c49-9fdd-954165520367_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:54:27.830240 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:54:27.831618 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] _write_metadata started, container name: volumebackups, metadata filename: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025422/az_nova_backup_aa091326-bf1f-4c49-9fdd-954165520367_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:54:27.857675 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "aa091326-bf1f-4c49-9fdd-954165520367",\n "backup_name": null,\n "created_at": "2026-06-26 02:54:18+00:00",\n "objects": [],\n "parent_id": "aefe7a33-300f-4877-9367-e4ca536a037d",\n "version": "1.0.0",\n "volume_id": "9d49b35d-ed83-4b48-8eaa-e04ae16c4aae",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"9d49b35d-ed83-4b48-8eaa-e04ae16c4aae\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"3f08f0507eec40189b858129b4cc7fd1\\", \\"project_id\\": \\"c05f689c58a04254b3930f0cc279148c\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:52:40.000000\\", \\"launched_at\\": \\"2026-06-26T02:52:40.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-2010384547\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:52:40.000000\\", \\"updated_at\\": \\"2026-06-26T02:54:18.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:54:27.861510 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] backup aa091326-bf1f-4c49-9fdd-954165520367 finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:54:27.993495 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:54:28.002334 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:28.002743 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:28.015530 np0000003683 sudo[150788]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk Jun 26 02:54:28.016171 np0000003683 sudo[150788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:54:28.120860 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:28.120860 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:28.337633 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:28.372132 np0000003683 sudo[150788]: pam_unix(sudo:session): session closed for user root Jun 26 02:54:28.374065 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk" returned: 0 in 0.381s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:54:28.374722 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799142', 'path': '/dev/sdk'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:54:28.374984 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:54:28.375465 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:54:28.375877 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6 Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129 Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:54:28.388377 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:28.389179 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:54:28.389179 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:54:28.389179 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:54:28.389179 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:54:28.418421 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:28.418421 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:28.418421 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:28.418421 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:28.418421 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:28.418421 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:28.418421 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:28.418421 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:28.418421 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:28.418421 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:28.418421 np0000003683 cinder-backup[101221]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129 (non-flash) Jun 26 02:54:28.418421 np0000003683 cinder-backup[101221]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6 (non-flash) Jun 26 02:54:28.418421 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:28.418885 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:28.418885 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:28.418885 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:28.418885 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:28.418885 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:28.418885 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:28.418885 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:28.418885 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:28.418885 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:28.418885 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:28.418885 np0000003683 cinder-backup[101221]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129 (non-flash) Jun 26 02:54:28.418885 np0000003683 cinder-backup[101221]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6 (non-flash) Jun 26 02:54:28.418885 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:54:28.419112 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '164'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6', '172')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:54:28.419175 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6', '172')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:54:28.420625 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Resulting device map defaultdict(. at 0x79db5ac5cea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6'): ({'sdk'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:54:28.420905 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Removing single pathed devices sdk {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:54:28.431086 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Flushing IO for device /dev/sdk {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:54:28.439974 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:54:28.503881 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Checking to see if SCSI volumes sdk have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:54:28.504117 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] SCSI volumes sdk have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:54:28.505423 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Checking to see if device paths {'sdk'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:54:28.514982 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Device paths {'sdk'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:54:28.515209 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:54:28.524551 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:28.563864 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 172, target: iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6, portal: 192.168.40.100,3260] Jun 26 02:54:28.563864 np0000003683 cinder-backup[101221]: Logout of [sid: 172, target: iqn.2023-03.storpool.com:os--volume-dd7174b8-e3d4-494f-9e1b-cfc3433d3dc6, portal: 192.168.40.100,3260] successful. Jun 26 02:54:28.563864 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:28.582568 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:28.582902 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.207s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:54:28.583134 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] <== disconnect_volume: return (208ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:54:28.593101 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:28.593101 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:28.723023 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:28.723506 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:28.725010 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=161,cinder:UPDATE=35,cinder:INSERT=5 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:54:28.927018 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:29.188083 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:29.188233 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:29.288817 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:29.289024 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:29.470583 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:29.635902 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-3a5c461c-5f09-4326-b5c9-ec315cf48577 tempest-VolumesBackupsTest-1738581805 None] Create backup finished. backup: aa091326-bf1f-4c49-9fdd-954165520367. Jun 26 02:54:29.729144 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:29.729612 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:29.841948 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:29.842190 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:30.026085 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:30.269088 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:30.269304 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:30.375036 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:30.375313 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:30.468411 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-aa33d9e4-1b9a-4581-ad33-1959120bc067 tempest-VolumesBackupsTest-1738581805 None] Delete backup started, backup: aa091326-bf1f-4c49-9fdd-954165520367. Jun 26 02:54:30.475225 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-aa33d9e4-1b9a-4581-ad33-1959120bc067 tempest-VolumesBackupsTest-1738581805 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_c05f689c58a04254b3930f0cc279148c {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:54:30.475451 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-aa33d9e4-1b9a-4581-ad33-1959120bc067 tempest-VolumesBackupsTest-1738581805 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:54:30.475961 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-aa33d9e4-1b9a-4581-ad33-1959120bc067 tempest-VolumesBackupsTest-1738581805 None] delete started, backup: aa091326-bf1f-4c49-9fdd-954165520367, container: volumebackups, prefix: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025422/az_nova_backup_aa091326-bf1f-4c49-9fdd-954165520367. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:54:30.545933 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-aa33d9e4-1b9a-4581-ad33-1959120bc067 tempest-VolumesBackupsTest-1738581805 None] generated object list: ['volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025422/az_nova_backup_aa091326-bf1f-4c49-9fdd-954165520367_metadata', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025422/az_nova_backup_aa091326-bf1f-4c49-9fdd-954165520367_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:54:30.573842 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-aa33d9e4-1b9a-4581-ad33-1959120bc067 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025422/az_nova_backup_aa091326-bf1f-4c49-9fdd-954165520367_metadata in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:30.593082 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-aa33d9e4-1b9a-4581-ad33-1959120bc067 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025422/az_nova_backup_aa091326-bf1f-4c49-9fdd-954165520367_sha256file in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:30.593495 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-aa33d9e4-1b9a-4581-ad33-1959120bc067 tempest-VolumesBackupsTest-1738581805 None] delete aa091326-bf1f-4c49-9fdd-954165520367 finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:54:30.620465 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:30.627423 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-aa33d9e4-1b9a-4581-ad33-1959120bc067 tempest-VolumesBackupsTest-1738581805 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:54:30.645847 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-aa33d9e4-1b9a-4581-ad33-1959120bc067 tempest-VolumesBackupsTest-1738581805 None] Created reservations ['c5a3e461-509e-4f50-ac92-4012d5c12403', 'b166059f-30d2-4ec9-b893-0a31769bda81'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:54:30.674318 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-aa33d9e4-1b9a-4581-ad33-1959120bc067 tempest-VolumesBackupsTest-1738581805 None] Delete backup finished, backup aa091326-bf1f-4c49-9fdd-954165520367 deleted. Jun 26 02:54:30.869988 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:30.870446 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:30.971175 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:30.971391 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:31.180256 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:31.458702 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:31.459356 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:31.584020 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:31.584354 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:31.630058 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Create backup started, backup: 883f7edb-b76c-4e02-8253-42fe14653872 volume: 9d49b35d-ed83-4b48-8eaa-e04ae16c4aae. Jun 26 02:54:31.635095 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-535872650',created_at=2026-06-26T02:54:31Z,data_timestamp=2026-06-26T02:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-238022714',encryption_key_id=None,fail_reason=None,host='np0000003683',id=883f7edb-b76c-4e02-8253-42fe14653872,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(aefe7a33-300f-4877-9367-e4ca536a037d),parent_id='aefe7a33-300f-4877-9367-e4ca536a037d',project_id='c05f689c58a04254b3930f0cc279148c',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3f08f0507eec40189b858129b4cc7fd1',volume_id=9d49b35d-ed83-4b48-8eaa-e04ae16c4aae) Jun 26 02:54:31.705402 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_c05f689c58a04254b3930f0cc279148c {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:54:31.705701 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:54:31.705965 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:54:31.717173 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:54:31.765445 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:54:31.784600 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:54:31.784884 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:54:31.794057 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:54:31.795492 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe1b:478e', 'fe80::60d2:cff:feb1:8775', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fede:7f47', 'fe80::20a8:2eff:fe3d:d21b', 'fe80::fc16:3eff:feb6:73a3', 'fe80::38a4:7cff:fefd:e5ef', 'fe80::fc16:3eff:fe77:fb01', 'fe80::fc16:3eff:fe6e:25dd'] Jun 26 02:54:31.795651 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:54:31.795760 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:54:31.795988 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:54:31.833973 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:32.098114 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:32.098574 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:32.210553 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:32.210722 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:32.247933 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:54:32.300728 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:54:32.300991 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e845f0e0-a019-4711-a20b-8e2448175d8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:54:32.301495 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:54:32.303156 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:54:32.303156 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e845f0e0-a019-4711-a20b-8e2448175d8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:54:32.312782 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:54:32.313311 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:54:32.313514 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:54:32.324555 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:54:32.324555 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:32.333880 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b] added Jun 26 02:54:32.333880 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:54:32.333880 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:54:32.333880 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:54:32.333880 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:54:32.333880 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:54:32.333880 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:32.334234 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:54:32.334955 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0209(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:54:32.334955 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:54:32.430685 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:32.694700 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:32.694845 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:32.800088 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:32.800256 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:32.978996 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:33.233125 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:33.233555 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:33.335453 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:54:33.345265 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:33.345451 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:54:33.353289 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:33.368663 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:33.386268 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:33.386268 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:33.386268 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:33.386268 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:33.386268 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:33.386268 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:33.386268 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:33.386268 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:33.386268 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:33.386268 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:33.386268 np0000003683 cinder-backup[101221]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129 (non-flash) Jun 26 02:54:33.386268 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:33.386735 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:33.386735 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:33.386735 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:33.386735 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:33.386735 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:33.386735 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:33.386735 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:33.386735 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:33.386735 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:33.386735 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:33.386735 np0000003683 cinder-backup[101221]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129 (non-flash) Jun 26 02:54:33.386735 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:54:33.436154 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b, portal: 192.168.40.100,3260] Jun 26 02:54:33.436154 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b, portal: 192.168.40.100,3260] successful. Jun 26 02:54:33.436154 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:33.448797 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:33.466365 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:33.466365 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:33.466365 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:33.466365 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:33.466365 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:33.466365 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:33.466365 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:33.466365 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:33.466365 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:33.466365 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:33.466365 np0000003683 cinder-backup[101221]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129 (non-flash) Jun 26 02:54:33.466365 np0000003683 cinder-backup[101221]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b (non-flash) Jun 26 02:54:33.466365 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:33.466923 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:33.466923 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:33.466923 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:33.466923 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:33.466923 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:33.466923 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:33.466923 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:33.466923 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:33.466923 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:33.466923 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:33.466923 np0000003683 cinder-backup[101221]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129 (non-flash) Jun 26 02:54:33.466923 np0000003683 cinder-backup[101221]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b (non-flash) Jun 26 02:54:33.466923 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:54:33.466923 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:54:33.467444 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:54:33.468366 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] HCTL ('16', '-', '-', 0) found on session 173 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:54:33.468522 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Scanning host 16 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:54:33.482004 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:54:33.483691 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Searching for a device in session 173 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:54:33.483774 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e845f0e0-a019-4711-a20b-8e2448175d8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:54:33.611247 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:54:33.611406 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:54:33.674436 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup MD5 for volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:54:33.674744 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:54:33.683063 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:54:33.691075 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:54:33.691328 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:54:33.696459 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:54:33.696684 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:54:33.700486 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:54:33.700826 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] _write_sha256file started, container name: tempest-volumesbackupsadmintest-backup-container-482573766, sha256file filename: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:54:33.765775 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:54:33.766523 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] _write_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-482573766, metadata filename: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:54:33.791451 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "6ad41494-3c08-40d2-9ad5-b2c12faf433a",\n "backup_name": "tempest-VolumesBackupsAdminTest-Backup-1626414748",\n "created_at": "2026-06-26 02:54:17+00:00",\n "objects": [\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "8bfc7aa6-1746-4bb3-80ed-6c073d3c1129",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"8bfc7aa6-1746-4bb3-80ed-6c073d3c1129\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"f0457c70da9b425dbc2ac13bb2100173\\", \\"project_id\\": \\"114c0bf7bbc44628b0d55341c3995675\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:54:16.000000\\", \\"launched_at\\": \\"2026-06-26T02:54:16.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsAdminTest-Volume-119917239\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:54:16.000000\\", \\"updated_at\\": \\"2026-06-26T02:54:17.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:54:33.797573 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] backup 6ad41494-3c08-40d2-9ad5-b2c12faf433a finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:54:33.919760 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:54:33.938599 np0000003683 sudo[150904]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj Jun 26 02:54:33.939237 np0000003683 sudo[150904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:54:34.253136 np0000003683 sudo[150904]: pam_unix(sudo:session): session closed for user root Jun 26 02:54:34.255250 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj" returned: 0 in 0.335s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:54:34.256001 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8bfc7aa6-1746-4bb3-80ed-6c073d3c1129', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799140', 'path': '/dev/sdj'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:54:34.256275 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:54:34.487962 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.186s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:54:34.488215 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] <== connect_volume: return (2187ms) {'type': 'block', 'scsi_wwn': '3300000001942a920', 'path': '/dev/sdk'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:54:34.488764 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:54:34.495615 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.238s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:54:34.496567 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8bfc7aa6-1746-4bb3-80ed-6c073d3c1129', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:54:34.507307 np0000003683 sudo[150907]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk Jun 26 02:54:34.508083 np0000003683 sudo[150907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129 Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:54:34.509544 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:34.510312 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:54:34.510312 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:54:34.510312 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:54:34.510312 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:54:34.536162 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:34.536162 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:34.536162 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:34.536162 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:34.536162 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:34.536162 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:34.536162 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:34.536162 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:34.536162 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:34.536162 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:34.536162 np0000003683 cinder-backup[101221]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129 (non-flash) Jun 26 02:54:34.536162 np0000003683 cinder-backup[101221]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b (non-flash) Jun 26 02:54:34.536162 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:34.536724 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:34.536724 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:34.536724 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:34.536724 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:34.536724 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:34.536724 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:34.536724 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:34.536724 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:34.536724 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:34.536724 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:34.536724 np0000003683 cinder-backup[101221]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129 (non-flash) Jun 26 02:54:34.536724 np0000003683 cinder-backup[101221]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b (non-flash) Jun 26 02:54:34.536724 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:54:34.536724 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '164'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b', '173')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:54:34.536724 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129', '171')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:54:34.537839 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Resulting device map defaultdict(. at 0x79db5ac75120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129'): ({'sdj'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:54:34.538046 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Removing single pathed devices sdj {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:54:34.547366 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Flushing IO for device /dev/sdj {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:54:34.556004 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:54:34.603975 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Checking to see if SCSI volumes sdj have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:54:34.604174 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] SCSI volumes sdj have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:54:34.605830 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Checking to see if device paths {'sdj'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:54:34.615915 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Device paths {'sdj'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:54:34.616182 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:54:34.626891 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:34.673458 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 171, target: iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129, portal: 192.168.40.100,3260] Jun 26 02:54:34.673458 np0000003683 cinder-backup[101221]: Logout of [sid: 171, target: iqn.2023-03.storpool.com:os--volume-8bfc7aa6-1746-4bb3-80ed-6c073d3c1129, portal: 192.168.40.100,3260] successful. Jun 26 02:54:34.673458 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:34.690465 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:34.690777 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.196s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:54:34.690948 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] <== disconnect_volume: return (434ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:54:34.815132 np0000003683 sudo[150907]: pam_unix(sudo:session): session closed for user root Jun 26 02:54:34.817210 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk" returned: 0 in 0.328s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:54:34.823470 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] _read_sha256file started, container name: tempest-volumesbackupstest-backup-container-2102453304, sha256 filename: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d_sha256file. {{(pid=101221) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jun 26 02:54:34.863925 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] _read_sha256file finished. {{(pid=101221) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jun 26 02:54:34.871080 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] _create_container started, container: tempest-volumesbackupstest-backup-container-535872650,backup: 883f7edb-b76c-4e02-8253-42fe14653872. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:54:34.923179 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] generate_object_name_prefix: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025434/az_nova_backup_883f7edb-b76c-4e02-8253-42fe14653872 {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:54:34.931956 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] starting backup of volume: 9d49b35d-ed83-4b48-8eaa-e04ae16c4aae, volume size: 1073741824, object names prefix volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025434/az_nova_backup_883f7edb-b76c-4e02-8253-42fe14653872, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:54:35.712162 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-c1f65a87-171d-4b1f-9f2d-7ffa47b8588d tempest-VolumesBackupsAdminTest-1620442085 None] Create backup finished. backup: 6ad41494-3c08-40d2-9ad5-b2c12faf433a. Jun 26 02:54:35.842199 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-eb53a33e-085e-4fe3-a9d0-a90de3158553 tempest-VolumesBackupsAdminTest-1709869487 None] Reset backup status started, backup_id: 6ad41494-3c08-40d2-9ad5-b2c12faf433a, status: error. Jun 26 02:54:35.842462 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-eb53a33e-085e-4fe3-a9d0-a90de3158553 tempest-VolumesBackupsAdminTest-1709869487 None] Backup service: cinder.backup.drivers.swift.SwiftBackupDriver. Jun 26 02:54:35.900311 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] Delete backup started, backup: 6ad41494-3c08-40d2-9ad5-b2c12faf433a. Jun 26 02:54:35.906577 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_114c0bf7bbc44628b0d55341c3995675 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:54:35.907098 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:54:35.907285 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] delete started, backup: 6ad41494-3c08-40d2-9ad5-b2c12faf433a, container: tempest-volumesbackupsadmintest-backup-container-482573766, prefix: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:54:35.979129 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] generated object list: ['volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00001', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00002', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00003', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00004', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00005', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00006', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00007', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00008', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00009', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00010', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00011', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00012', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00013', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00014', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00015', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00016', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00017', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00018', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00019', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00020', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00021', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a_metadata', 'volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:54:36.015657 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00001 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.050643 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00002 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.073319 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00003 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.114600 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00004 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.122524 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:54:36.138670 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00005 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00006 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00007 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00008 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00009 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00010 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00011 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00012 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00013 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00014 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00015 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00016 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00017 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00018 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00019 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00020 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a-00021 in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a_metadata in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] deleted object: volume_8bfc7aa6-1746-4bb3-80ed-6c073d3c1129/20260626025420/az_nova_backup_6ad41494-3c08-40d2-9ad5-b2c12faf433a_sha256file in container: tempest-volumesbackupsadmintest-backup-container-482573766. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:36.777886 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] delete 6ad41494-3c08-40d2-9ad5-b2c12faf433a finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:54:36.818204 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] Created reservations ['a791efa2-d8d2-46e2-97ae-5a1d69cc23ea', '005202b9-58e5-4994-ab97-f9a6c54fb053'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:54:36.847455 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-1d1f59be-8d71-42d0-9ee0-c08b8187ad92 tempest-VolumesBackupsAdminTest-1620442085 None] Delete backup finished, backup 6ad41494-3c08-40d2-9ad5-b2c12faf433a deleted. Jun 26 02:54:39.168493 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:54:39.175878 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:54:39.176155 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:54:39.181156 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:54:39.181391 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:54:39.185083 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:54:39.185383 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-535872650, sha256file filename: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025434/az_nova_backup_883f7edb-b76c-4e02-8253-42fe14653872_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:54:39.249627 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:54:39.250674 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-535872650, metadata filename: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025434/az_nova_backup_883f7edb-b76c-4e02-8253-42fe14653872_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:54:39.274646 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "883f7edb-b76c-4e02-8253-42fe14653872",\n "backup_name": "tempest-VolumesBackupsTest-Backup-238022714",\n "created_at": "2026-06-26 02:54:32+00:00",\n "objects": [],\n "parent_id": "aefe7a33-300f-4877-9367-e4ca536a037d",\n "version": "1.0.0",\n "volume_id": "9d49b35d-ed83-4b48-8eaa-e04ae16c4aae",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"9d49b35d-ed83-4b48-8eaa-e04ae16c4aae\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"3f08f0507eec40189b858129b4cc7fd1\\", \\"project_id\\": \\"c05f689c58a04254b3930f0cc279148c\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:52:40.000000\\", \\"launched_at\\": \\"2026-06-26T02:52:40.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-2010384547\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:52:40.000000\\", \\"updated_at\\": \\"2026-06-26T02:54:32.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:54:39.280454 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] backup 883f7edb-b76c-4e02-8253-42fe14653872 finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:54:39.440439 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:54:39.463103 np0000003683 sudo[151171]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk Jun 26 02:54:39.464051 np0000003683 sudo[151171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:54:39.805998 np0000003683 sudo[151171]: pam_unix(sudo:session): session closed for user root Jun 26 02:54:39.808000 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk" returned: 0 in 0.367s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:54:39.808685 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e845f0e0-a019-4711-a20b-8e2448175d8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000001942a920', 'path': '/dev/sdk'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:54:39.808886 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:54:39.809392 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:54:39.809786 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e845f0e0-a019-4711-a20b-8e2448175d8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:54:39.822662 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:39.823410 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:54:39.823410 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:54:39.823410 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:54:39.823410 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:54:39.854756 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:39.854756 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:39.854756 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:39.854756 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:39.854756 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:39.854756 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:39.854756 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:39.854756 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:39.854756 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:39.854756 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:39.854756 np0000003683 cinder-backup[101221]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b (non-flash) Jun 26 02:54:39.854756 np0000003683 cinder-backup[101221]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash) Jun 26 02:54:39.854756 np0000003683 cinder-backup[101221]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash) Jun 26 02:54:39.854756 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:54:39.855132 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:39.855132 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:54:39.855132 np0000003683 cinder-backup[101221]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:39.855132 np0000003683 cinder-backup[101221]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae (non-flash) Jun 26 02:54:39.855132 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:39.855132 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:54:39.855132 np0000003683 cinder-backup[101221]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:39.855132 np0000003683 cinder-backup[101221]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903 (non-flash) Jun 26 02:54:39.855132 np0000003683 cinder-backup[101221]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:39.855132 np0000003683 cinder-backup[101221]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b (non-flash) Jun 26 02:54:39.855132 np0000003683 cinder-backup[101221]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b (non-flash) Jun 26 02:54:39.855132 np0000003683 cinder-backup[101221]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash) Jun 26 02:54:39.855132 np0000003683 cinder-backup[101221]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc (non-flash) Jun 26 02:54:39.855132 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:54:39.855132 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d49b35d-ed83-4b48-8eaa-e04ae16c4aae', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f12a25be-e0f3-4e2b-b8f2-4744459a3903', '164'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aa1a627c-23d9-4058-a9bf-7f68c54bff1b', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b', '173'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', '174'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6139f634-bf14-4896-b77a-8295e043bacc', '175')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:54:39.855614 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b', '173')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:54:39.856615 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Resulting device map defaultdict(. at 0x79db5ac76480>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b'): ({'sdk'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:54:39.856860 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Removing single pathed devices sdk {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:54:39.867168 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Flushing IO for device /dev/sdk {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:54:39.878591 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:54:39.936236 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Checking to see if SCSI volumes sdk have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:54:39.936456 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] SCSI volumes sdk have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:54:39.938855 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Checking to see if device paths {'sdk'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:54:39.949528 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Device paths {'sdk'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:54:39.949827 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:54:39.962462 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:40.005508 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 173, target: iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b, portal: 192.168.40.100,3260] Jun 26 02:54:40.005508 np0000003683 cinder-backup[101221]: Logout of [sid: 173, target: iqn.2023-03.storpool.com:os--volume-e845f0e0-a019-4711-a20b-8e2448175d8b, portal: 192.168.40.100,3260] successful. Jun 26 02:54:40.005508 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:40.028777 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:54:40.028777 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.219s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:54:40.028777 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] <== disconnect_volume: return (220ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:54:41.072494 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-cf9ccdfe-e5f1-43ec-b05f-b78704966fc4 tempest-VolumesBackupsTest-1738581805 None] Create backup finished. backup: 883f7edb-b76c-4e02-8253-42fe14653872. Jun 26 02:54:41.992138 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-a9e0eca2-f38d-4fdb-8c03-3452fc9fafac tempest-VolumesBackupsTest-1738581805 None] Delete backup started, backup: 883f7edb-b76c-4e02-8253-42fe14653872. Jun 26 02:54:42.003492 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-a9e0eca2-f38d-4fdb-8c03-3452fc9fafac tempest-VolumesBackupsTest-1738581805 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_c05f689c58a04254b3930f0cc279148c {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:54:42.003950 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-a9e0eca2-f38d-4fdb-8c03-3452fc9fafac tempest-VolumesBackupsTest-1738581805 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:54:42.004214 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a9e0eca2-f38d-4fdb-8c03-3452fc9fafac tempest-VolumesBackupsTest-1738581805 None] delete started, backup: 883f7edb-b76c-4e02-8253-42fe14653872, container: tempest-volumesbackupstest-backup-container-535872650, prefix: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025434/az_nova_backup_883f7edb-b76c-4e02-8253-42fe14653872. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:54:42.047756 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a9e0eca2-f38d-4fdb-8c03-3452fc9fafac tempest-VolumesBackupsTest-1738581805 None] generated object list: ['volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025434/az_nova_backup_883f7edb-b76c-4e02-8253-42fe14653872_metadata', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025434/az_nova_backup_883f7edb-b76c-4e02-8253-42fe14653872_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:54:42.067275 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a9e0eca2-f38d-4fdb-8c03-3452fc9fafac tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025434/az_nova_backup_883f7edb-b76c-4e02-8253-42fe14653872_metadata in container: tempest-volumesbackupstest-backup-container-535872650. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:42.088380 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a9e0eca2-f38d-4fdb-8c03-3452fc9fafac tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025434/az_nova_backup_883f7edb-b76c-4e02-8253-42fe14653872_sha256file in container: tempest-volumesbackupstest-backup-container-535872650. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:42.088716 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a9e0eca2-f38d-4fdb-8c03-3452fc9fafac tempest-VolumesBackupsTest-1738581805 None] delete 883f7edb-b76c-4e02-8253-42fe14653872 finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:54:42.121992 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-a9e0eca2-f38d-4fdb-8c03-3452fc9fafac tempest-VolumesBackupsTest-1738581805 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:54:42.134817 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-a9e0eca2-f38d-4fdb-8c03-3452fc9fafac tempest-VolumesBackupsTest-1738581805 None] Created reservations ['9e9c6202-9349-43d9-8abf-fa0d8b97c526', '8f2fffef-ba6f-445b-9bda-fefede8daf75'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:54:42.156045 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-a9e0eca2-f38d-4fdb-8c03-3452fc9fafac tempest-VolumesBackupsTest-1738581805 None] Delete backup finished, backup 883f7edb-b76c-4e02-8253-42fe14653872 deleted. Jun 26 02:54:43.130881 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] Delete backup started, backup: aefe7a33-300f-4877-9367-e4ca536a037d. Jun 26 02:54:43.134106 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_c05f689c58a04254b3930f0cc279148c {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:54:43.134741 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:54:43.134919 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] delete started, backup: aefe7a33-300f-4877-9367-e4ca536a037d, container: tempest-volumesbackupstest-backup-container-2102453304, prefix: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:54:43.180700 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] generated object list: ['volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00001', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00002', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00003', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00004', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00005', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00006', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00007', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00008', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00009', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00010', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00011', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00012', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00013', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00014', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00015', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00016', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00017', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00018', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00019', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00020', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00021', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d_metadata', 'volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:54:43.201546 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00001 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.230954 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00002 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.250304 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00003 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.271524 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00004 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.290650 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00005 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.310343 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00006 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.328783 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00007 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.349922 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00008 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.374816 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00009 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.397744 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00010 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.416521 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00011 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.437889 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00012 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.460001 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00013 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.483829 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00014 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.502415 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00015 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.522964 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00016 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.543904 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00017 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.563650 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00018 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.583026 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00019 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.604921 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00020 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.624709 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d-00021 in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.656562 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d_metadata in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.677846 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] deleted object: volume_9d49b35d-ed83-4b48-8eaa-e04ae16c4aae/20260626025400/az_nova_backup_aefe7a33-300f-4877-9367-e4ca536a037d_sha256file in container: tempest-volumesbackupstest-backup-container-2102453304. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:54:43.678125 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] delete aefe7a33-300f-4877-9367-e4ca536a037d finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:54:43.723754 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:54:43.737410 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] Created reservations ['f40bfdb3-1f78-4ecf-83c8-64f80cfa6574', 'ec15a22f-f5af-4152-a0cb-e895ed9f6273'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:54:43.753414 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-2d913cc1-06cb-4ff3-ac8e-3beb6556d5a1 tempest-VolumesBackupsTest-1738581805 None] Delete backup finished, backup aefe7a33-300f-4877-9367-e4ca536a037d deleted. Jun 26 02:54:53.751635 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=84,cinder:UPDATE=41,cinder:INSERT=8 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:55:12.702736 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:55:12.703165 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:55:31.580704 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Create backup started, backup: ade593d7-f5d4-4491-b1f6-f8c245b94f6d volume: d38ec335-4ed3-45d3-8f43-2533716a2277. Jun 26 02:55:31.585833 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-06-26T02:55:31Z,data_timestamp=2026-06-26T02:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromBackupTest-Backup-1612594704',encryption_key_id=None,fail_reason=None,host='np0000003683',id=ade593d7-f5d4-4491-b1f6-f8c245b94f6d,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='3a54449842264f42bab1301227bc5e8d',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='05cf04ed96df48e696cdc1a4d867df8d',volume_id=d38ec335-4ed3-45d3-8f43-2533716a2277) Jun 26 02:55:31.610239 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_3a54449842264f42bab1301227bc5e8d {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:55:31.610516 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:55:31.610909 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:55:31.620799 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:55:31.640698 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:55:31.654169 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:55:31.654456 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:55:31.662605 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:55:31.663624 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fe2e:eaa9', 'fe80::1026:c3ff:fe56:e906', 'fe80::fc16:3eff:fe8f:f0d3', 'fe80::d8b4:17ff:fedc:9e5b'] Jun 26 02:55:31.663801 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:55:31.664012 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:55:31.664299 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] <== get_connector_properties: return (53ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:55:32.168883 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:55:32.169464 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd38ec335-4ed3-45d3-8f43-2533716a2277', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:55:32.169737 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:55:41.602763 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:55:50.715031 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-a333b490-193d-427d-9c3a-368f0d8effb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:56:00.720380 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:56:12.706249 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:56:12.706708 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:56:28.047382 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 55.878s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:56:28.047847 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd38ec335-4ed3-45d3-8f43-2533716a2277', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:56:28.058251 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:56:28.058633 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:56:28.058820 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:56:28.067925 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:56:28.067925 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:56:28.078415 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277] added Jun 26 02:56:28.078415 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:56:28.078415 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:56:28.078415 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:56:28.078415 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:56:28.078415 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:56:28.078415 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:56:28.078691 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:56:28.078986 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0201(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:56:28.079146 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:56:29.080793 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:56:29.091917 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:56:29.102035 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:56:29.116369 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:56:29.116369 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:56:29.116369 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:56:29.116369 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:56:29.116369 np0000003683 cinder-backup[101221]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash) Jun 26 02:56:29.116369 np0000003683 cinder-backup[101221]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash) Jun 26 02:56:29.116369 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:56:29.116662 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:56:29.116662 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:56:29.116662 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:56:29.116662 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:56:29.116662 np0000003683 cinder-backup[101221]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash) Jun 26 02:56:29.116662 np0000003683 cinder-backup[101221]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash) Jun 26 02:56:29.116662 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:56:29.157096 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277, portal: 192.168.40.100,3260] Jun 26 02:56:29.157096 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277, portal: 192.168.40.100,3260] successful. Jun 26 02:56:29.157096 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:56:29.168270 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:56:29.185487 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:56:29.185487 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:56:29.185487 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:56:29.185487 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:56:29.185487 np0000003683 cinder-backup[101221]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash) Jun 26 02:56:29.185487 np0000003683 cinder-backup[101221]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash) Jun 26 02:56:29.185487 np0000003683 cinder-backup[101221]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash) Jun 26 02:56:29.185487 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:56:29.185787 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:56:29.185787 np0000003683 cinder-backup[101221]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e468ef0f-cf10-4197-995e-7e9e013410e9 (non-flash) Jun 26 02:56:29.185787 np0000003683 cinder-backup[101221]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:56:29.185787 np0000003683 cinder-backup[101221]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb02ec99-ccf7-431e-8e6d-ce6b5593f717 (non-flash) Jun 26 02:56:29.185787 np0000003683 cinder-backup[101221]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash) Jun 26 02:56:29.185787 np0000003683 cinder-backup[101221]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429a6f9f-49fb-4187-b488-69ecf01f3006 (non-flash) Jun 26 02:56:29.185787 np0000003683 cinder-backup[101221]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash) Jun 26 02:56:29.185787 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:56:29.186159 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.127s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:56:29.186159 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:56:29.186923 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] HCTL ('13', '-', '-', 0) found on session 186 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:56:29.187100 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:56:29.201140 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Searching for a device in session 186 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:56:29.201140 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd38ec335-4ed3-45d3-8f43-2533716a2277', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:56:30.204430 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.157s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:56:30.204873 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] <== connect_volume: return (58034ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799174', 'path': '/dev/sdh'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:56:30.205532 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:56:30.223257 np0000003683 sudo[153495]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jun 26 02:56:30.223990 np0000003683 sudo[153495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:56:30.564322 np0000003683 sudo[153495]: pam_unix(sudo:session): session closed for user root Jun 26 02:56:30.566648 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.361s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:56:30.575070 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] _create_container started, container: volumebackups,backup: ade593d7-f5d4-4491-b1f6-f8c245b94f6d. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:56:30.702321 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] generate_object_name_prefix: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:56:30.707861 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] starting backup of volume: d38ec335-4ed3-45d3-8f43-2533716a2277, volume size: 1073741824, object names prefix volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:56:30.896407 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:31.142658 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:31.142798 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:31.252265 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:31.252739 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:31.431100 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:31.683191 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:31.685144 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:31.783903 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:31.784215 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:31.974677 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:32.213749 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:32.214026 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:32.312401 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:32.312820 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:32.502724 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:32.746408 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:32.746605 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:32.848327 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:32.848499 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:33.073399 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:33.357619 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:33.358176 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:33.467052 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:33.467216 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:33.667297 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:33.911716 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:33.911929 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:34.013449 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:34.013658 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:34.226623 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:34.469098 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:34.469565 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:34.573576 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:34.573738 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:34.791210 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:35.030946 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:35.031136 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:35.131801 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:35.131968 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:35.338241 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:35.603124 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:35.603124 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:35.703898 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:35.704073 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:35.902398 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:36.153124 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:36.153329 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:36.257594 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:36.257866 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:36.483539 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:36.742358 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:36.742702 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:36.848211 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:36.848358 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:37.067664 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:37.319679 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:37.320139 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:37.429986 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:37.430156 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:37.663253 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:37.927147 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:37.927555 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:38.032695 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:38.032957 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:38.228993 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:38.504286 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:38.504434 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:38.619559 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:38.619828 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:38.876700 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:39.146420 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:39.146841 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:39.272360 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:39.272612 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:39.498962 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:39.756715 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:39.756954 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:39.867677 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:39.867815 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:40.065610 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:40.317362 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:40.317759 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:40.421835 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:40.422036 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:40.688184 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:40.932704 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:40.932861 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:41.050377 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:41.050588 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:41.247792 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:41.493755 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:41.494321 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:41.603794 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:41.604063 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:41.792602 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:42.034098 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:42.034256 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:42.134360 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:42.134360 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:42.242201 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:56:42.370871 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:56:42.371142 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:56:42.435597 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup MD5 for volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:56:42.435807 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:56:42.442536 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:56:42.448433 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:56:42.448745 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:56:42.453046 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:56:42.453265 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:56:42.456564 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] No metadata type 'volume-glance-metadata' available {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jun 26 02:56:42.456861 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:56:42.514516 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:56:42.515236 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] _write_metadata started, container name: volumebackups, metadata filename: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:56:42.542751 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "ade593d7-f5d4-4491-b1f6-f8c245b94f6d",\n "backup_name": "tempest-CreateVolumesFromBackupTest-Backup-1612594704",\n "created_at": "2026-06-26 02:55:32+00:00",\n "objects": [\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "d38ec335-4ed3-45d3-8f43-2533716a2277",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"d38ec335-4ed3-45d3-8f43-2533716a2277\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"05cf04ed96df48e696cdc1a4d867df8d\\", \\"project_id\\": \\"3a54449842264f42bab1301227bc5e8d\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:55:30.000000\\", \\"launched_at\\": \\"2026-06-26T02:55:31.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-CreateVolumesFromBackupTest-Volume-510302689\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:55:30.000000\\", \\"updated_at\\": \\"2026-06-26T02:55:32.000000\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:56:42.548247 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] backup ade593d7-f5d4-4491-b1f6-f8c245b94f6d finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:56:42.680687 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:56:42.700104 np0000003683 sudo[153871]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jun 26 02:56:42.700719 np0000003683 sudo[153871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:56:43.005777 np0000003683 sudo[153871]: pam_unix(sudo:session): session closed for user root Jun 26 02:56:43.007788 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.327s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:56:43.008433 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd38ec335-4ed3-45d3-8f43-2533716a2277', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799174', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:56:43.008690 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:56:43.009230 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:56:43.009647 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd38ec335-4ed3-45d3-8f43-2533716a2277', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:56:43.019698 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:56:43.019698 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:56:43.019698 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:56:43.019698 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:56:43.019698 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:56:43.019698 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 Jun 26 02:56:43.019698 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:56:43.019698 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:56:43.019698 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 Jun 26 02:56:43.019698 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:56:43.019698 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:56:43.019698 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:56:43.019698 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:56:43.019698 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:56:43.019698 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:56:43.019698 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:56:43.020085 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:56:43.020085 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:56:43.020085 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:56:43.020171 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:56:43.043078 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash) Jun 26 02:56:43.043078 np0000003683 cinder-backup[101221]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash) Jun 26 02:56:43.043078 np0000003683 cinder-backup[101221]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash) Jun 26 02:56:43.043078 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:56:43.043247 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277 (non-flash) Jun 26 02:56:43.043247 np0000003683 cinder-backup[101221]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash) Jun 26 02:56:43.043247 np0000003683 cinder-backup[101221]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363 (non-flash) Jun 26 02:56:43.043247 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:56:43.043398 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fd9685d-5bc2-4eb3-9b3c-49bfede5b363', '188')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:56:43.043554 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277', '186')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:56:43.044757 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Resulting device map defaultdict(. at 0x79db5a7d53a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277'): ({'sdh'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:56:43.045046 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Removing single pathed devices sdh {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:56:43.062365 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Flushing IO for device /dev/sdh {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:56:43.073042 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:56:43.139128 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:56:43.139313 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] SCSI volumes sdh have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:56:43.140243 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:56:43.152557 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:56:43.152557 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:56:43.162799 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:56:43.193741 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 186, target: iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277, portal: 192.168.40.100,3260] Jun 26 02:56:43.193741 np0000003683 cinder-backup[101221]: Logout of [sid: 186, target: iqn.2023-03.storpool.com:os--volume-d38ec335-4ed3-45d3-8f43-2533716a2277, portal: 192.168.40.100,3260] successful. Jun 26 02:56:43.193741 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:56:43.208353 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:56:43.208669 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.199s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:56:43.208853 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] <== disconnect_volume: return (200ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:56:44.230700 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-737ae53c-ba69-4151-9dc8-95c9fb9f39b4 tempest-CreateVolumesFromBackupTest-1746376479 None] Create backup finished. backup: ade593d7-f5d4-4491-b1f6-f8c245b94f6d. Jun 26 02:56:45.998055 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] Delete backup started, backup: ade593d7-f5d4-4491-b1f6-f8c245b94f6d. Jun 26 02:56:46.005926 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_3a54449842264f42bab1301227bc5e8d {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:56:46.006962 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:56:46.007183 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] delete started, backup: ade593d7-f5d4-4491-b1f6-f8c245b94f6d, container: volumebackups, prefix: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 02:56:46.047910 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] generated object list: ['volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00001', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00002', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00003', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00004', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00005', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00006', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00007', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00008', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00009', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00010', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00011', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00012', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00013', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00014', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00015', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00016', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00017', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00018', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00019', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00020', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00021', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d_metadata', 'volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:56:46.064195 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00001 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.086593 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00002 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.103772 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00003 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.126772 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00004 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.151813 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00005 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.173648 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00006 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.196616 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00007 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.217686 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00008 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.244132 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00009 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.265626 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00010 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.294337 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00011 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.313368 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00012 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.330472 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00013 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.348624 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00014 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.365938 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00015 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.385969 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00016 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.415920 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00017 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.446708 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00018 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.480282 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00019 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.521642 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00020 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.547254 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d-00021 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.575773 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d_metadata in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.604657 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] deleted object: volume_d38ec335-4ed3-45d3-8f43-2533716a2277/20260626025630/az_nova_backup_ade593d7-f5d4-4491-b1f6-f8c245b94f6d_sha256file in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 02:56:46.604861 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] delete ade593d7-f5d4-4491-b1f6-f8c245b94f6d finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 02:56:46.638587 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:56:46.656191 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] Created reservations ['4ded4882-cc6b-4589-9116-74c540bceb82', '0c2a4e68-577f-4b9f-9610-38d1cb4192e7'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 02:56:46.677972 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-1014543e-ecec-4b28-818b-551166cf6986 tempest-CreateVolumesFromBackupTest-1746376479 None] Delete backup finished, backup ade593d7-f5d4-4491-b1f6-f8c245b94f6d deleted. Jun 26 02:56:56.674745 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=36,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:57:12.710229 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:57:12.710892 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:58:00.690723 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 02:58:12.713274 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:58:12.713845 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:59:12.716315 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 02:59:12.717137 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 02:59:26.453285 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Create backup started, backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd volume: 2f48658d-e45f-456c-b496-7a5a7c32d151. Jun 26 02:59:26.457260 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-06-26T02:59:26Z,data_timestamp=2026-06-26T02:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-backup-1650056517',encryption_key_id=None,fail_reason=None,host='np0000003683',id=1f5970ee-2dd0-49de-8b11-c389f63587fd,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a083fd09bdb84fab848b17e71e63b280',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='53d7f036feb0484290b0c45ee5d80bfd',volume_id=2f48658d-e45f-456c-b496-7a5a7c32d151) Jun 26 02:59:26.479395 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_a083fd09bdb84fab848b17e71e63b280 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:59:26.479693 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:59:26.480010 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:59:26.489324 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:59:26.506930 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:59:26.521812 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:59:26.522125 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:59:26.529710 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:59:26.530790 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fee4:7a6b', 'fe80::d4b5:11ff:fee7:5f60'] Jun 26 02:59:26.530964 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:59:26.531128 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:59:26.531442 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] <== get_connector_properties: return (50ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:59:27.035721 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:59:27.036170 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f48658d-e45f-456c-b496-7a5a7c32d151', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:59:27.036362 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:59:27.036865 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:59:27.037087 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f48658d-e45f-456c-b496-7a5a7c32d151', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:59:27.047750 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:59:27.048179 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:59:27.048394 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:59:27.058174 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:59:27.058174 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:59:27.069611 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151] added Jun 26 02:59:27.069611 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:59:27.069611 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:59:27.069611 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:59:27.069611 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:59:27.069611 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:59:27.069611 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:59:27.069868 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:59:27.070213 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0217(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:59:27.070390 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:59:28.072295 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:59:28.081530 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:59:28.093244 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:59:28.105758 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:28.105758 np0000003683 cinder-backup[101221]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:28.105758 np0000003683 cinder-backup[101221]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 02:59:28.105758 np0000003683 cinder-backup[101221]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 02:59:28.105758 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:59:28.106007 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:28.106007 np0000003683 cinder-backup[101221]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:28.106007 np0000003683 cinder-backup[101221]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 02:59:28.106007 np0000003683 cinder-backup[101221]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 02:59:28.106007 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:59:28.134724 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151, portal: 192.168.40.100,3260] Jun 26 02:59:28.134724 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151, portal: 192.168.40.100,3260] successful. Jun 26 02:59:28.134724 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:59:28.143629 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:59:28.155942 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:28.155942 np0000003683 cinder-backup[101221]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:28.155942 np0000003683 cinder-backup[101221]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 02:59:28.155942 np0000003683 cinder-backup[101221]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 02:59:28.155942 np0000003683 cinder-backup[101221]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151 (non-flash) Jun 26 02:59:28.155942 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:59:28.156206 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:28.156206 np0000003683 cinder-backup[101221]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:28.156206 np0000003683 cinder-backup[101221]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 02:59:28.156206 np0000003683 cinder-backup[101221]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 02:59:28.156206 np0000003683 cinder-backup[101221]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151 (non-flash) Jun 26 02:59:28.156206 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:59:28.156389 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.108s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:59:28.156546 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:59:28.157234 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] HCTL ('11', '-', '-', 0) found on session 215 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:59:28.157359 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Scanning host 11 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:59:28.167641 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Searching for a device in session 215 and hctl ['11', '*', '*', 0] yield: None {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:59:29.169239 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Searching for a device in session 215 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:59:29.169622 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f48658d-e45f-456c-b496-7a5a7c32d151', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:59:29.170582 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.134s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:59:29.170794 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] <== connect_volume: return (2134ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799226', 'path': '/dev/sdf'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:59:29.171214 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:59:29.188839 np0000003683 sudo[158853]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf Jun 26 02:59:29.189462 np0000003683 sudo[158853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:59:29.494693 np0000003683 sudo[158853]: pam_unix(sudo:session): session closed for user root Jun 26 02:59:29.496868 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf" returned: 0 in 0.325s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:59:29.536942 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:59:29.544363 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] _create_container started, container: volumebackups,backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd. {{(pid=101221) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jun 26 02:59:29.659991 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] generate_object_name_prefix: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd {{(pid=101221) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jun 26 02:59:29.665255 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] starting backup of volume: 2f48658d-e45f-456c-b496-7a5a7c32d151, volume size: 1073741824, object names prefix volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd, availability zone: nova {{(pid=101221) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jun 26 02:59:29.865401 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:30.582378 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 19825286 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:30.582877 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:30.807270 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00001: 82571f7121cb9475563edde615e4e4df {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:30.807418 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:31.016256 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:31.255200 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:31.255335 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:31.359189 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:31.359343 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:31.548860 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:31.810356 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 1362154 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:31.810823 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:31.916967 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00003: a35891500449df17e893f84bd88472fb {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:31.917171 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:32.091317 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:32.339066 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:32.339198 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:32.437365 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:32.437555 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:32.620167 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:32.858594 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:32.859031 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:32.959668 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:32.959839 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:33.141242 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:33.376849 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:33.377018 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:33.476583 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:33.476768 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:33.668594 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:33.911877 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:33.912285 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:34.016901 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:34.017042 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:34.227500 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:34.466240 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:34.466364 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:34.581597 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:34.581913 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:34.816400 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:35.058655 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:35.058952 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:35.156632 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:35.156904 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:35.325363 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:35.567033 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:35.567199 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:35.663065 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:35.663284 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:35.823383 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:36.061884 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:36.062204 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:36.160062 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:36.160207 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:36.341168 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:36.583150 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:36.583313 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:36.681174 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:36.681270 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:36.859052 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:37.097010 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:37.097427 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:37.193452 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:37.193669 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:37.368800 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:37.604307 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:37.604491 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:37.702038 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:37.702313 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:37.891335 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:38.144700 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:38.145312 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:38.248860 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:38.249071 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:38.456124 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:38.702506 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:38.702710 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:38.801791 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:38.802044 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:39.006618 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:39.252566 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:39.253066 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:39.351428 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:39.351656 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:39.532695 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:39.779742 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:39.779865 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:39.881650 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:39.881921 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:40.069882 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:40.319664 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:40.320074 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:40.416801 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:40.416996 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:40.629004 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:40.869713 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:40.869889 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:40.967130 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:40.967323 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:41.061786 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Backing up chunk of data from volume. {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jun 26 02:59:41.178897 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101221) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jun 26 02:59:41.179155 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] About to put_object {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jun 26 02:59:41.242858 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup MD5 for volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jun 26 02:59:41.243024 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Calling eventlet.sleep(0) {{(pid=101221) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jun 26 02:59:41.249736 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Getting metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jun 26 02:59:41.254955 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101221) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jun 26 02:59:41.255135 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Getting metadata type 'volume-metadata' {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jun 26 02:59:41.259709 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] No metadata type 'volume-metadata' available {{(pid=101221) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jun 26 02:59:41.259933 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Getting metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jun 26 02:59:41.263969 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101221) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jun 26 02:59:41.264232 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd_sha256file. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jun 26 02:59:41.318002 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] _write_sha256file finished. {{(pid=101221) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jun 26 02:59:41.318756 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] _write_metadata started, container name: volumebackups, metadata filename: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd_metadata. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jun 26 02:59:41.340855 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "1f5970ee-2dd0-49de-8b11-c389f63587fd",\n "backup_name": "tempest-TestVolumeBackupRestore-backup-1650056517",\n "created_at": "2026-06-26 02:59:26+00:00",\n "objects": [\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "82571f7121cb9475563edde615e4e4df",\n "offset": 0\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "a35891500449df17e893f84bd88472fb",\n "offset": 104857600\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "2f48658d-e45f-456c-b496-7a5a7c32d151",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"2f48658d-e45f-456c-b496-7a5a7c32d151\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"53d7f036feb0484290b0c45ee5d80bfd\\", \\"project_id\\": \\"a083fd09bdb84fab848b17e71e63b280\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000003683@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-06-26T02:59:25.000000\\", \\"launched_at\\": \\"2026-06-26T02:59:26.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-TestVolumeBackupRestore-volume-1646331287\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"268cd356-e153-49dd-857f-2ea5794ac5be\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"26cf225a-ef51-42c6-990c-f9523cca3d45\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-06-26T02:59:25.000000\\", \\"updated_at\\": \\"2026-06-26T02:59:26.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"eb0918cd-17b7-4dc6-8a46-002286996c07\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101221) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jun 26 02:59:41.346113 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] backup 1f5970ee-2dd0-49de-8b11-c389f63587fd finished. {{(pid=101221) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jun 26 02:59:41.462931 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:59:41.484049 np0000003683 sudo[158993]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf Jun 26 02:59:41.484935 np0000003683 sudo[158993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:59:41.811361 np0000003683 sudo[158993]: pam_unix(sudo:session): session closed for user root Jun 26 02:59:41.813606 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf" returned: 0 in 0.350s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:59:41.814514 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f48658d-e45f-456c-b496-7a5a7c32d151', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799226', 'path': '/dev/sdf'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:59:41.814775 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:59:41.815375 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:59:41.815887 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f48658d-e45f-456c-b496-7a5a7c32d151', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 02:59:41.827188 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 02:59:41.827188 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:59:41.827188 np0000003683 cinder-backup[101221]: iSNS: Jun 26 02:59:41.827188 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:59:41.827188 np0000003683 cinder-backup[101221]: STATIC: Jun 26 02:59:41.827188 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db Jun 26 02:59:41.827188 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 02:59:41.827188 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:59:41.827188 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:59:41.827188 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:59:41.827188 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151 Jun 26 02:59:41.827188 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 02:59:41.827188 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 02:59:41.827188 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 02:59:41.827188 np0000003683 cinder-backup[101221]: No targets found. Jun 26 02:59:41.827188 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:59:41.827644 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 02:59:41.827644 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 02:59:41.827644 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 02:59:41.827929 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 02:59:41.849522 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:41.849522 np0000003683 cinder-backup[101221]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:41.849522 np0000003683 cinder-backup[101221]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151 (non-flash) Jun 26 02:59:41.849522 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:59:41.849736 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:41.849736 np0000003683 cinder-backup[101221]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:41.849736 np0000003683 cinder-backup[101221]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151 (non-flash) Jun 26 02:59:41.849736 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:59:41.849982 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '210'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151', '215')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 02:59:41.850128 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151', '215')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 02:59:41.851084 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Resulting device map defaultdict(. at 0x79db5ab7fe20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151'): ({'sdf'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 02:59:41.851378 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Removing single pathed devices sdf {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 02:59:41.863185 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Flushing IO for device /dev/sdf {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 02:59:41.872068 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 02:59:41.928879 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Checking to see if SCSI volumes sdf have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 02:59:41.929123 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] SCSI volumes sdf have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 02:59:41.930144 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Checking to see if device paths {'sdf'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 02:59:41.941833 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Device paths {'sdf'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 02:59:41.942162 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 02:59:41.953179 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:59:41.983224 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 215, target: iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151, portal: 192.168.40.100,3260] Jun 26 02:59:41.983224 np0000003683 cinder-backup[101221]: Logout of [sid: 215, target: iqn.2023-03.storpool.com:os--volume-2f48658d-e45f-456c-b496-7a5a7c32d151, portal: 192.168.40.100,3260] successful. Jun 26 02:59:41.983224 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:59:41.998172 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:59:41.998337 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.183s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:59:41.998397 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] <== disconnect_volume: return (183ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:59:43.019814 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-4550f790-a4e3-4813-81b9-e035c34baa62 tempest-TestVolumeBackupRestore-507346053 None] Create backup finished. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd. Jun 26 02:59:45.027959 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Restore backup started, backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. Jun 26 02:59:45.040754 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_a083fd09bdb84fab848b17e71e63b280 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 02:59:45.041172 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 02:59:45.041536 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.9', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:59:45.051449 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.scaleio [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101221) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 02:59:45.070725 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Running cmd (subprocess): nvme version {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:59:45.083473 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] 'nvme version' failed. Not Retrying. {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 02:59:45.083863 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] nvme not present on system {{(pid=101221) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 02:59:45.091511 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101221) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 02:59:45.092378 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.lightos [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Current host hostNQN and IP(s) are ['10.4.3.9', 'fe80::f816:3eff:fe10:87ea', '192.168.40.6', 'fe80::f816:3eff:feb4:184e', '192.168.50.6', 'fe80::f816:3eff:fe5f:e17c', '192.168.10.6', 'fe80::f816:3eff:fe24:cb75', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::707b:96ff:fef6:d246', 'fe80::fc16:3eff:fee4:7a6b', 'fe80::d4b5:11ff:fee7:5f60'] Jun 26 02:59:45.092601 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 02:59:45.092674 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.lightos [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] LIGHTOS: no hostnqn found. {{(pid=101221) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 02:59:45.092935 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] <== get_connector_properties: return (51ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.9', 'host': 'np0000003683', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f538bde6dd7', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '0f9b6f66-39b4-4e40-a8fd-87dc4e236f72', 'nvme_native_multipath': False} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:59:46.099544 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connector [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Factory for iscsi on None {{(pid=101221) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 02:59:46.100141 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58e936c2-c1d0-4577-8d30-118325bc60f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:59:46.100230 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:59:47.859418 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.759s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:59:47.859858 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58e936c2-c1d0-4577-8d30-118325bc60f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 02:59:47.871251 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 02:59:47.871694 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 02:59:47.871910 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:59:47.881647 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 02:59:47.881647 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:59:47.892162 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6] added Jun 26 02:59:47.892162 np0000003683 cinder-backup[101221]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 02:59:47.892162 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:59:47.892162 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:59:47.892162 np0000003683 cinder-backup[101221]: iscsiadm: Config file line 363 does not have value Jun 26 02:59:47.892162 np0000003683 cinder-backup[101221]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 02:59:47.892162 np0000003683 cinder-backup[101221]: {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:59:47.892429 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101221) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 02:59:47.892748 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0207(s), this was the 1st time calling it. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 02:59:47.892929 np0000003683 cinder-backup[101221]: DEBUG os_brick.utils [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101221) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 02:59:48.893843 np0000003683 cinder-backup[101221]: INFO os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.name = iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.tpgt = -1 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.startup = manual Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.leading_login = No Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.iscsi_ifacename = default Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.net_ifacename = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.ipaddress = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.prefix_len = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.hwaddress = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.transport_name = tcp Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.initiatorname = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.state = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.vlan_id = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.vlan_priority = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.vlan_state = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.iface_num = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.mtu = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.port = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.bootproto = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.subnet_mask = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.gateway = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id_state = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.dhcp_alt_client_id = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.dhcp_dns = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.dhcp_learn_iqn = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.dhcp_req_vendor_id_state = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id_state = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.dhcp_vendor_id = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.dhcp_slp_da = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.fragmentation = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.gratuitous_arp = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.incoming_forwarding = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.tos_state = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.tos = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.ttl = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.delayed_ack = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.tcp_nagle = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.tcp_wsf_state = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.tcp_wsf = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.tcp_timer_scale = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.tcp_timestamp = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.redirect = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.def_task_mgmt_timeout = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.header_digest = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.data_digest = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.immediate_data = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.initial_r2t = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.data_seq_inorder = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.data_pdu_inorder = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.erl = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.max_receive_data_len = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.first_burst_len = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.max_outstanding_r2t = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.max_burst_len = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.chap_auth = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.bidi_chap = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.strict_login_compliance = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.discovery_auth = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: iface.discovery_logout = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.discovery_address = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.discovery_port = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.discovery_type = fw Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.initial_cmdsn = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.initial_login_retry_max = 8 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.xmit_thread_priority = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.cmds_max = 128 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.queue_depth = 32 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.nr_sessions = 1 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.auth.authmethod = None Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.auth.username = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.auth.password = *** Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.auth.username_in = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.auth.password_in = Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.auth.chap_algs = SHA256 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.timeo.replacement_timeout = 120 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.err_timeo.abort_timeout = 15 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.iscsi.FastAbort = Yes Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.iscsi.InitialR2T = No Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.iscsi.ImmediateData = Yes Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxConnections = 1 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.iscsi.ERL = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.scan = auto Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.session.reopen_max = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.conn[0].address = 192.168.40.100 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.conn[0].port = 3260 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.conn[0].startup = manual Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.conn[0].tcp.window_size = 524288 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.conn[0].tcp.type_of_service = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.conn[0].timeo.logout_timeout = 15 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.conn[0].timeo.login_timeout = 15 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.conn[0].timeo.auth_timeout = 45 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.HeaderDigest = None Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.DataDigest = None Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.IFMarker = No Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: node.conn[0].iscsi.OFMarker = No Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: # END RECORD Jun 26 02:59:48.904545 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:59:48.915317 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:59:48.927159 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:48.927159 np0000003683 cinder-backup[101221]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:48.927159 np0000003683 cinder-backup[101221]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 02:59:48.927159 np0000003683 cinder-backup[101221]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 02:59:48.927159 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:59:48.927399 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:48.927399 np0000003683 cinder-backup[101221]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:48.927399 np0000003683 cinder-backup[101221]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 02:59:48.927399 np0000003683 cinder-backup[101221]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 02:59:48.927399 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:59:48.965592 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6, portal: 192.168.40.100,3260] Jun 26 02:59:48.965592 np0000003683 cinder-backup[101221]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6, portal: 192.168.40.100,3260] successful. Jun 26 02:59:48.965592 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:59:48.979351 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 02:59:48.993973 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:48.993973 np0000003683 cinder-backup[101221]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:48.993973 np0000003683 cinder-backup[101221]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 02:59:48.993973 np0000003683 cinder-backup[101221]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 02:59:48.993973 np0000003683 cinder-backup[101221]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash) Jun 26 02:59:48.993973 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 02:59:48.994278 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:48.994278 np0000003683 cinder-backup[101221]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 02:59:48.994278 np0000003683 cinder-backup[101221]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 02:59:48.994278 np0000003683 cinder-backup[101221]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 02:59:48.994278 np0000003683 cinder-backup[101221]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash) Jun 26 02:59:48.994278 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 02:59:48.994719 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.123s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:59:48.994923 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Connected to 192.168.40.100:3260 {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 02:59:48.995954 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] HCTL ('11', '-', '-', 0) found on session 218 with lun 0 {{(pid=101221) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 02:59:48.996176 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Scanning host 11 c: -, t: -, l: 0) {{(pid=101221) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 02:59:49.009896 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Searching for a device in session 218 and hctl ['11', '*', '*', 0] yield: None {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:59:50.010447 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Searching for a device in session 218 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=101221) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 02:59:50.010956 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58e936c2-c1d0-4577-8d30-118325bc60f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101221) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 02:59:50.011468 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.152s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 02:59:50.011674 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] <== connect_volume: return (3911ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799228', 'path': '/dev/sdf'} {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 02:59:50.012031 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:59:50.036067 np0000003683 sudo[159248]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf Jun 26 02:59:50.036915 np0000003683 sudo[159248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:59:50.336653 np0000003683 sudo[159248]: pam_unix(sudo:session): session closed for user root Jun 26 02:59:50.338785 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf" returned: 0 in 0.326s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:59:50.339320 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] starting restore of backup volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd container: volumebackups, to new volume 58e936c2-c1d0-4577-8d30-118325bc60f6, backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd. {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jun 26 02:59:50.339572 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] _read_metadata started, container name: volumebackups, metadata filename: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd_metadata. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] _read_metadata finished. Metadata: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "backup_description": null, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "backup_id": "1f5970ee-2dd0-49de-8b11-c389f63587fd", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "backup_name": "tempest-TestVolumeBackupRestore-backup-1650056517", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "created_at": "2026-06-26 02:59:26+00:00", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "objects": [ Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00001": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "82571f7121cb9475563edde615e4e4df", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 0 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00002": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 52428800 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00003": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "a35891500449df17e893f84bd88472fb", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 104857600 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00004": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 157286400 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00005": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 209715200 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00006": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 262144000 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00007": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 314572800 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00008": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 367001600 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00009": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 419430400 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00010": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 471859200 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00011": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 524288000 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00012": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 576716800 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00013": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 629145600 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00014": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 681574400 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00015": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 734003200 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00016": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 786432000 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00017": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 838860800 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00018": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 891289600 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00019": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 943718400 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00020": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 996147200 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00021": { Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "length": 25165824, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "offset": 1048576000 Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: ], Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "parent_id": null, Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "version": "1.0.0", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_id": "2f48658d-e45f-456c-b496-7a5a7c32d151", Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"2f48658d-e45f-456c-b496-7a5a7c32d151\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"53d7f036feb0484290b0c45ee5d80bfd\", \"project_id\": \"a083fd09bdb84fab848b17e71e63b280\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000003683@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-06-26T02:59:25.000000\", \"launched_at\": \"2026-06-26T02:59:26.000000\", \"terminated_at\": null, \"display_name\": \"tempest-TestVolumeBackupRestore-volume-1646331287\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"268cd356-e153-49dd-857f-2ea5794ac5be\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"26cf225a-ef51-42c6-990c-f9523cca3d45\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-06-26T02:59:25.000000\", \"updated_at\": \"2026-06-26T02:59:26.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"eb0918cd-17b7-4dc6-8a46-002286996c07\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jun 26 02:59:50.357274 np0000003683 cinder-backup[101221]: }. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jun 26 02:59:50.362072 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Restoring backup version 1.0.0 {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jun 26 02:59:50.362072 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] _read_metadata started, container name: volumebackups, metadata filename: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd_metadata. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] _read_metadata finished. Metadata: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "backup_description": null, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "backup_id": "1f5970ee-2dd0-49de-8b11-c389f63587fd", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "backup_name": "tempest-TestVolumeBackupRestore-backup-1650056517", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "created_at": "2026-06-26 02:59:26+00:00", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "objects": [ Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00001": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "82571f7121cb9475563edde615e4e4df", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 0 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00002": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 52428800 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00003": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "a35891500449df17e893f84bd88472fb", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 104857600 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00004": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 157286400 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00005": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 209715200 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00006": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 262144000 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00007": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 314572800 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00008": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 367001600 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00009": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 419430400 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00010": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 471859200 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00011": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 524288000 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00012": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 576716800 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00013": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 629145600 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00014": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 681574400 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00015": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 734003200 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00016": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 786432000 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00017": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 838860800 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00018": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 891289600 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00019": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 943718400 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00020": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 52428800, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "25e317773f308e446cc84c503a6d1f85", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 996147200 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00021": { Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "compression": "zlib", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "length": 25165824, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "offset": 1048576000 Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: } Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: ], Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "parent_id": null, Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "version": "1.0.0", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_id": "2f48658d-e45f-456c-b496-7a5a7c32d151", Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"2f48658d-e45f-456c-b496-7a5a7c32d151\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"53d7f036feb0484290b0c45ee5d80bfd\", \"project_id\": \"a083fd09bdb84fab848b17e71e63b280\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000003683@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-06-26T02:59:25.000000\", \"launched_at\": \"2026-06-26T02:59:26.000000\", \"terminated_at\": null, \"display_name\": \"tempest-TestVolumeBackupRestore-volume-1646331287\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"268cd356-e153-49dd-857f-2ea5794ac5be\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"26cf225a-ef51-42c6-990c-f9523cca3d45\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-06-26T02:59:25.000000\", \"updated_at\": \"2026-06-26T02:59:26.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"eb0918cd-17b7-4dc6-8a46-002286996c07\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jun 26 02:59:50.372898 np0000003683 cinder-backup[101221]: }. {{(pid=101221) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jun 26 02:59:50.377355 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] v1 volume backup restore of 1f5970ee-2dd0-49de-8b11-c389f63587fd started. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jun 26 02:59:50.377355 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] metadata_object_names = ['volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00001', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00002', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00003', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00004', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00005', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00006', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00007', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00008', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00009', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00010', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00011', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00012', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00013', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00014', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00015', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00016', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00017', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00018', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00019', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00020', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00021']. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jun 26 02:59:50.412564 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] generated object list: ['volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00001', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00002', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00003', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00004', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00005', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00006', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00007', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00008', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00009', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00010', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00011', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00012', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00013', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00014', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00015', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00016', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00017', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00018', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00019', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00020', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00021', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd_metadata', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 02:59:50.448287 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 02:59:50.453713 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00001, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:50.536534 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:50.994051 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00002, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:51.009757 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:51.381583 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00003, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:51.414995 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:51.800310 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00004, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:51.819561 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:52.166446 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00005, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:52.182054 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:52.543529 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00006, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:52.560306 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:52.910244 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00007, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:52.925283 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:53.266998 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00008, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:53.282108 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:53.629529 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00009, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:53.648118 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:54.006042 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00010, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:54.021905 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:54.355251 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00011, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:54.372252 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:54.726032 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00012, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:54.740737 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:55.098271 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00013, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:55.117212 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:55.489443 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00014, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:55.506949 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:55.858540 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00015, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:55.875409 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:56.222022 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00016, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:56.241296 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:56.581437 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00017, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:56.598508 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:56.931089 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00018, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:56.946978 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:57.303310 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00019, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:57.324859 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:57.706241 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00020, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:57.725320 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:58.071448 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restoring object. backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, object name: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00021, volume: 58e936c2-c1d0-4577-8d30-118325bc60f6. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jun 26 02:59:58.087391 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] decompressing data using zlib algorithm {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jun 26 02:59:58.252856 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] v1 volume backup restore of 1f5970ee-2dd0-49de-8b11-c389f63587fd finished. {{(pid=101221) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jun 26 02:59:58.253315 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Restoring volume base metadata {{(pid=101221) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jun 26 02:59:58.266754 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] No metadata of type 'volume-metadata' to restore {{(pid=101221) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jun 26 02:59:58.266914 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.driver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Restoring volume glance metadata {{(pid=101221) _restore_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:258}} Jun 26 02:59:58.383398 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] restore 1f5970ee-2dd0-49de-8b11-c389f63587fd to 58e936c2-c1d0-4577-8d30-118325bc60f6 finished. {{(pid=101221) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jun 26 02:59:58.394536 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 02:59:58.416376 np0000003683 sudo[159404]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf Jun 26 02:59:58.417033 np0000003683 sudo[159404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 02:59:58.812640 np0000003683 sudo[159404]: pam_unix(sudo:session): session closed for user root Jun 26 02:59:58.814941 np0000003683 cinder-backup[101221]: DEBUG oslo_concurrency.processutils [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf" returned: 0 in 0.421s {{(pid=101221) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 02:59:58.815602 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58e936c2-c1d0-4577-8d30-118325bc60f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799228', 'path': '/dev/sdf'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 02:59:58.815806 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 03:00:00.374561 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.557s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 03:00:00.374561 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58e936c2-c1d0-4577-8d30-118325bc60f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: No targets found. Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: iSNS: Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: No targets found. Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: STATIC: Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Portal: 192.168.50.100:3260,-1 Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Target: iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Portal: 192.168.40.100:3260,-1 Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: Iface Name: default Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: FIRMWARE: Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: No targets found. Jun 26 03:00:00.387078 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 03:00:00.387665 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jun 26 03:00:00.387665 np0000003683 cinder-backup[101221]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jun 26 03:00:00.387665 np0000003683 cinder-backup[101221]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101221) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jun 26 03:00:00.387775 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', 0)] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 03:00:00.416114 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 03:00:00.416114 np0000003683 cinder-backup[101221]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 03:00:00.416114 np0000003683 cinder-backup[101221]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 03:00:00.416114 np0000003683 cinder-backup[101221]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 03:00:00.416114 np0000003683 cinder-backup[101221]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash) Jun 26 03:00:00.416114 np0000003683 cinder-backup[101221]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash) Jun 26 03:00:00.416114 np0000003683 cinder-backup[101221]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash) Jun 26 03:00:00.416114 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 03:00:00.416573 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] iscsi session list stdout=tcp: [209] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 03:00:00.416573 np0000003683 cinder-backup[101221]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db (non-flash) Jun 26 03:00:00.416573 np0000003683 cinder-backup[101221]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 03:00:00.416573 np0000003683 cinder-backup[101221]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9 (non-flash) Jun 26 03:00:00.416573 np0000003683 cinder-backup[101221]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6 (non-flash) Jun 26 03:00:00.416573 np0000003683 cinder-backup[101221]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash) Jun 26 03:00:00.416573 np0000003683 cinder-backup[101221]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23 (non-flash) Jun 26 03:00:00.416573 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 03:00:00.416573 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-658d91ad-0838-47a5-926c-5b8fdbdcf1db', '210'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', '216'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3763222-4f1e-4d3a-93b7-33dc24c162f9', '217'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', '218'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', '219'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67b4244b-cfa3-4d57-bcae-1e03acad5e23', '220')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 03:00:00.416946 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6', '218')] {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 03:00:00.417705 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Resulting device map defaultdict(. at 0x79db5a7d4400>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6'): ({'sdf'}, set())}) {{(pid=101221) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 03:00:00.417918 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Removing single pathed devices sdf {{(pid=101221) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 03:00:00.430203 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Flushing IO for device /dev/sdf {{(pid=101221) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jun 26 03:00:00.438309 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=101221) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 03:00:00.507576 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Checking to see if SCSI volumes sdf have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 03:00:00.507784 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] SCSI volumes sdf have been removed. {{(pid=101221) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 03:00:00.509144 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Checking to see if device paths {'sdf'} are still under multipathd monitoring {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 03:00:00.520434 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.linuxscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Device paths {'sdf'} have been removed from multipathd monitoring. {{(pid=101221) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 03:00:00.520682 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6')] {{(pid=101221) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 03:00:00.531920 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 03:00:00.568067 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 218, target: iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6, portal: 192.168.40.100,3260] Jun 26 03:00:00.568067 np0000003683 cinder-backup[101221]: Logout of [sid: 218, target: iqn.2023-03.storpool.com:os--volume-58e936c2-c1d0-4577-8d30-118325bc60f6, portal: 192.168.40.100,3260] successful. Jun 26 03:00:00.568067 np0000003683 cinder-backup[101221]: stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 03:00:00.584524 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101221) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 03:00:00.585045 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.base [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.212s {{(pid=101221) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 03:00:00.585316 np0000003683 cinder-backup[101221]: DEBUG os_brick.initiator.connectors.iscsi [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] <== disconnect_volume: return (1769ms) None {{(pid=101221) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 03:00:01.607473 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.manager [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Encryption key ID for volume 58e936c2-c1d0-4577-8d30-118325bc60f6 already matches encryption key ID in backup 1f5970ee-2dd0-49de-8b11-c389f63587fd. {{(pid=101221) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jun 26 03:00:01.650198 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-a723a3ff-80ae-4560-98cb-75eb653e5c32 tempest-TestVolumeBackupRestore-507346053 None] Finished restoring backup 1f5970ee-2dd0-49de-8b11-c389f63587fd to volume 58e936c2-c1d0-4577-8d30-118325bc60f6. Jun 26 03:00:11.644586 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=88,cinder:UPDATE=12,cinder:INSERT=15 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 03:00:12.719638 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 03:00:12.720079 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 03:00:59.989800 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] Delete backup started, backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd. Jun 26 03:00:59.996901 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] Using swift URL https://10.4.3.9:8080/v1/AUTH_a083fd09bdb84fab848b17e71e63b280 {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jun 26 03:00:59.997198 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.drivers.swift [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] Connect to https://10.4.3.9:8080/v1/AUTH_ in "per_user" mode {{(pid=101221) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jun 26 03:00:59.997497 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] delete started, backup: 1f5970ee-2dd0-49de-8b11-c389f63587fd, container: volumebackups, prefix: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jun 26 03:01:00.066144 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] generated object list: ['volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00001', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00002', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00003', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00004', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00005', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00006', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00007', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00008', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00009', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00010', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00011', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00012', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00013', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00014', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00015', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00016', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00017', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00018', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00019', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00020', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00021', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd_metadata', 'volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd_sha256file']. {{(pid=101221) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jun 26 03:01:00.091192 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00001 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.115726 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00002 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.139556 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00003 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.160687 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00004 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.185935 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00005 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.209226 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00006 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.233900 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00007 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.256299 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00008 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.278973 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00009 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.303331 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00010 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.333765 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00011 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.360704 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00012 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.385356 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00013 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.406440 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00014 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.429502 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00015 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.455057 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00016 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.481342 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00017 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.502828 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00018 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.524252 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00019 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.545074 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00020 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.568849 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd-00021 in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.591420 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd_metadata in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.612819 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] deleted object: volume_2f48658d-e45f-456c-b496-7a5a7c32d151/20260626025929/az_nova_backup_1f5970ee-2dd0-49de-8b11-c389f63587fd_sha256file in container: volumebackups. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jun 26 03:01:00.613132 np0000003683 cinder-backup[101221]: DEBUG cinder.backup.chunkeddriver [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] delete 1f5970ee-2dd0-49de-8b11-c389f63587fd finished. {{(pid=101221) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jun 26 03:01:00.652257 np0000003683 cinder-backup[101221]: DEBUG oslo_db.sqlalchemy.engines [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101221) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 03:01:00.665842 np0000003683 cinder-backup[101221]: DEBUG cinder.quota [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] Created reservations ['aab8014a-aa9f-4752-bce5-973f3ceedf0a', '6728a705-7536-4330-a564-c43faae43e2b'] {{(pid=101221) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 03:01:00.682561 np0000003683 cinder-backup[101221]: INFO cinder.backup.manager [None req-6b9372d6-fffe-4068-8fbb-711eb0f99bc9 tempest-TestVolumeBackupRestore-507346053 None] Delete backup finished, backup 1f5970ee-2dd0-49de-8b11-c389f63587fd deleted. Jun 26 03:01:10.680459 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 03:01:12.723693 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 03:01:12.724193 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 03:02:00.724451 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 03:02:12.727941 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 03:02:12.728391 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 03:03:12.738709 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 03:03:12.738709 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 03:04:00.723509 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 03:04:12.735237 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 03:04:12.735839 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 03:06:00.724331 np0000003683 cinder-backup[101221]: DEBUG dbcounter [-] [101221] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101221) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 03:06:12.740151 np0000003683 cinder-backup[101221]: DEBUG oslo_service.periodic_task [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101221) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 03:06:12.740778 np0000003683 cinder-backup[101221]: DEBUG cinder.manager [None req-f326638e-0493-40e6-902c-5c0633505884 None None] Notifying Schedulers of capabilities ... {{(pid=101221) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}